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ABSTRACT 


This thesis evaluates techniques for forecasting the 
return of failed repairable spare parts (known as carcasses) 
within the U. S. Navy supply system by comparing the model 
currently implemented in the Uniform Automated Data Process- 
ing System Inventory Control Point (UICP) sree with 
several alternative forecasting models to determine if an 
improvement can be achieved in forecasting effectiveness. 

The current model uses an exponential smoothing procedure 

and applies several filtering processes to determine the 
appropriate smoothing constant value. The alternative models 
employ forecasting techniques such as moving average, moving 
least Squares, adaptive response rate, and regression 

analysis. Each model is then synthesized with actual U. S. 
Navy supply system data and its verformance measured by a 

Pe omee (elatlOmeeriteria, Mie results indicate that the 
current UICP forecasting model cannot be improved substantially 
Plamelaeea ti lcering process 1S Critical to the performance of 


any model applied to real world data. 
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I. INTRODUCTION 


This thesis compares the model currently implemented in 
the Uniform Automated Data Processing System Inventory 
Control Point (UICP) program for forecasting the return of 
failed repairable spare parts (known as carcasses) with 
several alternative forecasting models to determine if an 
improvement can be achieved in forecasting effectiveness. 
While the results of a study of forecasting techniques 
could apply to many aspects of the U.S. Navy repairable 
system, this study will specifically address only 
SPCC-managed non-aviation items. 

The primary function of the repairables inventory system 
is to maintain a high state of fleet readiness through 
material availability by efficient workload scheduling and 
maximizing financial resource allocations. The motivation 
behind this study is to look at one portion of the 
logistics system and determine if the currently employed 
forecasting techniques could be improved towards this 
end. 

The forecasting of carcass returns within the supply 
system plays a key role in both workload planning and 
budgeting. The carcass return forecast and the estimated 


demand determine the funding levels required to service the 





Metled units for reissue and the shortfall of units that 
must be funded as new purchases. Currently SPCC uses an 
exponential smoothing model with filters to forecast 
carcass returns. The scope of this thesis will be to 
formulate and test various forecasting models and to compare 
them to the current SPCC model. These models employ fore- 
casting techniques such as moving average, moving least 
Squares, adaptive response rate, and several regression 
analysis schemes. Each mode will be analyzed using two 
years of actual demand and carcass return data from a 
selected subgroup of repairable items managed by SPCC and 
evaluated with respect to various decision criteria. 

The thesis will first provide an overview of the 
repairable systems within the U.S. Navy and present the 
role of the Inventory Control Point (ICP) in the system. 
The overview includes discussion of the data files and the 
programs and basic inventory models used by the ICP. Then 
the forecasting algorithms and the motivation behind each 
examined forecasting model is presented. A separate section 
on model building concentrates on the evolution of regres- 
Sion models. The data selection criteria and the data 
collection procedure are addressed, and the measures of 
effectiveness that are used to evaluate the models are 
gectasea. Finally, the numerical results of the study 


are presented and discussed with respect to applicability 





and implementation. In general, the results indicate, first, 
that the current UICP forecasting model cannot be sub- 
stantially improved using the types of models considered 
here and, second, that a filtering process iS critical to 
the performance of the models when applied to real-world 


data. 
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It. THE CURRENT NAVY REPAIRABLES SYSTEM 


Ae foe REPATRABLES CYCLE 

Repairable spare parts are big business in the Navy 
today. Repairables became an economic necessity with the 
advent of increasing technological complexity of weapon 
systems and the rising costs of their components. Many of 
those components are not repairable onboard ship or at 
intermediate maintenance levels and must be repaired ata 
depot (Depot Level Repairables - DLR). Repairable items 
include electron tubes, circuit boards, test equipment, 
pumps, motors, turbine rotors, amplifiers, power supplies, 
etc. A key to fleet readiness is the availability of spare 
components within the supply system to keep these systems 
Operational. Today, SPCC manages approximately 100,000 
repairable items accounting for annual sales of approximately 
220 @mliliion. 

A part is classified as a repairable item rather than a 
consumable item if it is more economical to take that part 
back into the supply system and repair it for future use 
rather than purchase a new one. Repair costs including 
transportation, storage and handling generally average 
40-60 percent of the replacement price of the item. 

Repair turnaround time versus procurement lead time is also 


a key factor with repair times normally ranging from 90 to 


de 





180 days, as compared to the purchasing cycles of up to two 
years. The reasons for this difference in leadtimes vary, 
but, in general, the "repair bench" and piece parts are in 
place or readily accessible, whereas the manufacturer must 
tool up and obtain the raw materials and components to 
produce a new part. In other cases, there may be no pro- 
curement sources available and repair is the only 
alternative. 

The addition of a repairable system within the supply 
distribution system adds a unique dimension from the 
logistics point of view. In the private sector the 
logistician's work is basically completed once the product 
reaches the customer. If the product subsequently fails, 
the customer is responsible for pursuing repair actions or 
replacement. However, parallel systems, one for forward 
physical distribution and one for failed unit (carcass) 
returns or retrogrades, must be formed to support Navy 
repairables. Carcass collection and overhaul points must 
be designated, transportation facilities established, and 
complex inventory control decisions must be made. These 
decisions include the number of carcasses to induct into 
the repair cycle and when, the number of new DLRs to 
procure to replace normal attrition and increased demand, 
and the number of units to procure based upon manufacturing 


costs and lead times and the reorder levels. 
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The Navy repairable system for an SPCC managed item is 
depicted graphically in Figure 1. Figure 1 illustrates the 
theoretical flow of the DLR and attendant information flow. 
When a failure occurs, the customer initiates a requisition 
Greacmanad document to obtain a replacement part (desig- 
nated Ready For Issue (RFI)). Under the Area Supply Support 
Concept, the customer submits his requisition to the nearest 
stock point. This allows the stock point to record a 
demand, or hit, for future stocking computations. 

If the stock point has the item in stock, it issues the 
Bart £O Ehe customer and electronically transmits a report 
of the issue to the ICP via the Transaction Item Reporting 
(TIR) system. The TIR is processed by the ICP, adjusting 
on-hand balances for that part, recording the demand and 
establishing a "due-in" for the NRFI (Not Ready For Issue) 
aie ©. 

iemeiemetack point is temporarily out of the desired 
item or does not normally carry the part, the requisition 
Hen ferwardead to the ICP for disposition. The ICP processes 
fe demand by forwarding it to an activity that does have 
stock on-hand or backorders the items for release against 
forthcoming RFI assets, and adjusts the records 
accordingly. 

When the customer receives the RFI unit and installs it, 


he is operaticnal again. His role in the cycle is not 
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complete, however, until he returns the failed unit (called 
a carcass and designated NRFI) to the system so it can be 
repaired and placed back on the shelf as an RFI unit. The 
customer consults the Master Repairable Item List (MRIL) to 
determine the disposition of the carcass. The MRIL 
includes the Movement Priority Designator (MPD) which is 
assigned by the ICP and determines the transportation 
priority of the movement of the carcass. Once the NRFI 
unit is turned in (either at the time the initial demand 

is placed or subsequent to that), the stock point notifies 
the ICP through a TIR and the due-in is cancelled. The 
collection point (CP) is a location designated to receive 
and store all NRFI units until they are to be inducted into 
the repair cycle. It can be either a stock point or the 
designated overhaul point (DOP). Therefore, if the stock 
point receiving the NRFI item is the CP, it holds the 
material; otherwise it forwards the unit to the designated 
CP in accordance with MPD. The inventory manager then 
Gecides how best to get a unit back on the shelf at the 
tssummensteck point. This decision may mean the initiation 
CEeeecomait actions on a failed unit or the procurement of a 
new RFI item. These decisions are a function of recurring 
demand forecasts, carcasses currently in the repair cycle, 
NRFI assets awaiting repair at the CP, repair lead times, 


procurement lead times, and budgetary constraints. If the 


iD 





decision is to repair the unit, the unit is inducted into 
the repair cycle at one of over 20 Navy industrial facili- 
ties or 250 commercial designated overhaul points. Once 
repair action is complete, the RFI item is directed to 

a specific stock point by the ICP in the Redistribution 
Phase. The stock point receives and stores the RFI item 
until itis subsequently required to fill a requisition. If 
the decision to procure a new unit is made, a contract is 
established with a manufacturer and the new unit is sent to 
the designated stock point. 

Figure 2 illustrates the repairables pipeline. Ideal- 
ly, the system should function as closed loop with no loss 
of units from turn-in to reissue. In practice, losses of 
units occur at three points: (1) during the Exchange Phase 
when the customer either does not have an NRFI unit to turn 
Mimot Stes Weck in transit to the collection point; (2) 
during the Retrograde Phase when units are misplaced or are 
determined irreparable by the stock point and surveyed; and 
(3) during the Repair Phase when the unit is determined to 
be beyond economic repair by the DOP. These losses or 
"attrition" demands must be made up by an infusion of units 
into the system through procurement. 

This general cutline applies only to existing systems 
and does not address non-recurring demands such as initial 


outfitting, planned maintenance, ROH moOrtetung, backwidceing, 


is 
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etc., which are funded by the Hardware Systems Command (HSC) 
(e.g. NAVAIR, NAVSEA, NAVELEX, etc.). The recurring demand 
portion of the repairables system becomes involved only 


Gece the Lirst failure for these items. 


pesos ECP AND THE UICP SYSTEM 

Heeceswed basic understanding Of the role that carcass 
return forecasting plays in the overall repairables cycle 
Peweromimporcant to look at the ICP functions. The previous 
general discussion of the repairables cycle can be repre- 
sented basically as a wheel of repairables activity 
through the Uniform Automated Data Processing System - 
Inventory Control Point (UICP) generated and maintained 
by the Fleet Material Support Office (FMSO). Item managers, 
located at each ICP, are personally responsible for moni- 
Coming and directing the inventory control life of specific 
items. The item manager is the human aspect of the UICP 
system. He receives the UICP-generated information and 
makes critical inventory control decisions concerning the 
procurement, repair, and distribution of an item. The 
following presentation will discuss some of the UICP files 
that are maintained in support of the repairables program 
and associated UICP programs that actually manipulate the 
files to provide the repair/procure decisions and determine 


pudgetary requirements for the system. Figure 3 is a 
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graphic display of the relationship between the major UICP 
repairables files and programs. 

The Master Data File (MDF) contains the key data 
required to operate an inventory control system. Data is 
filed by National Item Identification Number (NIIN). Infor- 
mation about each item is stored in individually accessed 
locations called data element numbers or DEN's. Each NIIN 
has approximately 400 accompanying DEN's that contain such 
information as current inventory position, demand and 
Carcass return observations for the current quarter, demand 
and carcass return forecasts, procurement and repair lead 
times and turnaround times, dimensions, weight, standard and 
replacement prices, packing and preservation information, 
etc. The MDF is accessed via real-time data retrieval. 

The Planned Program Requirement File (PPR) keeps track 
of all known requirements (also called non-recurring 
demands) for RFI assets based upon requests from HSC's, 
industrial activities, customers and item managers. The 
PPR can be accessed in real time. 

The Due-in/Due-out File (DDF) tracks every outstanding 
Bieelyvedection until its completion or termination. It 
follows ICP directed issues and expected receipts (such as 
carcass returns once a repairable item has been issued to 
a customer). It also tracks incoming RFI assets from both 


repair and procurement, the redistribution of assets among 
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Steck points and DOPs, and items going into and out of the 
Repair Phase. The DDF can also be accessed in real time. 

The Transaction History File (THF) contains all the 
transactions recorded at the ICP over the preceeding two 
year period. It lists each transaction individually by 
document number and provides a sousce of historical data 
for demand observations, carcass returns, procurement lead 
times, and repair turnaround times. This file is on tape 
and can only be accessed through batch processing. 

The Inventory History File (IHF) is also a tape file 
that is accessed by batch processing. The IHF contains 
demand and carcass return observations for the previous 
eight quarters as well as inventory position quantities, 


lead times and turnaround times. 


Sotae Lik SYSTEM 

miematscuission will now focus on the UICP programs that 
access the data files described above and will explain how 
Ee mcelate to carcass return forecasting. First, it is 
important to understand the Transaction Item Reporting (TIR) 
system. If the repairables system can be thought of as a 
wheel with the repairable item moving around the rim and 
the ICP at the hub, the spokes of the wheel represent the 
TIR system. The TIR system is an information system that 
informs the ICP of every change in status of one of its 


wholesale system assets. That change in status can include 
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receipts of due-ins, carcass turn-ins, issues of RFI items, 
forwarding carcasses for repair, and inductions of carcasses 
into repair. TIR reports are sent via AUTODIN or message. 
At the end of each day an "accounting" is made of all 
transactions at a TIR activity and the transactions are 
TIR'ed to the ICP to update the asset position on all 
inventory control records. The commands that report daily 
to the ICP are referred to as being on the "wheel" and are 
eatlied TIR reporting activities (stock points, industrial 
activities, some air stations and some mobile logistic 
Support force ships). The ICP's also do business with non- 
TIR activities which are, in general, commercial DOP's. 
When a repairable item is sent to a non-TIR activity a due- 
in is established in the DDF and a blackout of information 
for that particular item is experienced pending its return 
EQuaeliR activity. Non-TIR activities do provide monthly 
inventory position reports to the ICP, but the information 
is not available in real time like the TIR. The progress 
of a repairable item is followed through the system by the 
item's condition code which is reported via TIR. The 


following condition codes [Ref. 3] generally apply to 


repairables: 
Condition Code Scacus 
A Serviceable (Issuable W/O Qual) 
F Unserviceable (Repairable) 
H Unserviceable (Condemnec) 
M Suspended (In Work) 


Ze 





When a carcass is turned in by the customer it is listed as 
Perma in Yr" condition. When that item is inducted into 
repair by a TIR reporting DOP, the condition code is changed 
wor wre If the carcass is sent to a non-TIR reporting DOP, 
it is reclassified "M" condition when it is forwarded from 
the last TIR reporting activity. If the carcass is declared 
irreparable, a TIR reporting DOP sends a TIR to the ICP 
changing the condition code to "H" and the item is deleted 
from the appropriate files. Non-TIR reporting DOP's notify 
the ICP via the monthly report and the ICP manually makes 
adjusting entries. Once the Repair Phase is completed, the 
RFI asset is forwarded to a stock point and the condition 
Bode 1S Upgraded to "A" condition. Thus, the status of a 
particular repairable item at any point in the repairables 


pipeline can be pinpointed by its condition code. 


D. UICP PROGRAMS 
UICP program B04 processes the TIR's sent to SPCC. The 
program receives the TIR's and updates the MDF, DDF and PPR 
files. Additionally it accomplishes the following: 
a) calculates lead times for repair and procurement; 
b) accumulates demand and carcass return data; 


GG) a@ecumulates repair inductions, regenerations and 
disposals; and 


d) generates follow-up inquiries on DDF overdue records. 
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UICP program BOl isthe requisition processing program. 
When a requisition is filled at the point of entry under 
the Area Supply Support Concept, the resulting issue is 
Peeeesoca at tne ICP through B04. If the stock point is 
out of stock or the item is not carried, the requisition is 
TIR'‘ed to the ICP and processed by BOl. This program bumps 
the requisition against system-wide stock availability and 
the requisition is then either passed by TIR to another 
stock point for issue or a backorder is created in the 
Document Status File (DSF). Then, the program provides 
status on the demand to the originator, updates the MDF with 
a demand observation, and establishes a due-out in the DDF. 

BO2 is the Planned Reguirements program and is used to 
update and manage the PPR file. This program works only 
with non-recurring demand such as initial outfitting, 
allowance increases, and planned overhauls. BOQ2 keeps track 
of known upcoming system needs and ensures that they are 
taken into consideration as requirements when economic order 


quantities and reorder levels are computed. 


E. THE LEVELS PROGRAM 

The cornerstone of the UICP system is the Cyclic Levels 
and Forecasting program DO1. The Levels program computes 
economic order and repair quantities as well as reorder and 
repair points. This program determines when to buy or 
E-saeeeandenow much to buy or repair. The Levels program 


is run quarterly and represents the budget execution 
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strategy of management through the establishment of inven- 
tory stocking objectives. The goal of the Levels program 
is to set the proper inventory stocking and reorder levels 
to maximize Supply Material Availability (SMA) at the 
minimum possible cost. SMA represents the percentage of 
the time that a requisition is filled by the supply system 
when it is initially submitted. The current system-wide 
goal established by the Naval Supply Systems Command 
(NAVSUP) is 85 percent. The costs to be minimized are the 
total variable costs associated with an inventory system - 
ordering, holding and stockout costs. An outline of the 
Levels program for repairables follows. 

1. The program draws its data base from the MDF. 

2. It sets the parameter values for the various calcu- 
lations. These parameters include the minimum or 
maximum risk factor depending upon the item's MARK 
classification (which will be discussed below); the 
storage cost; and the specific probability distri- 
bution to be used in the reorder point calculations. 

3. It forecasts the recurring demands and carcass 
returns and updates estimates of the repair survival 
rate and the repair and procurement turnaround 


times. 


4. It calculates the economic order quantity, reorder 
level, economic repair quantity, and repair level. 


5. It stores the newcalculations, forecasts and average 
updates in the MDF and the IHF. 


When determining the reorder level for an item, the 
Levels program selects from three probability distributions 
based upon the item's MARK classification and demand 


pattern. When demand is very low or the item is held only 
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for safety stock, the Poisson distribution is used to 
predict lead time demand patterns. For medium demand items, 
the negative binomial distribution is used and for high 
demand or fast moving items the normal distribution is used. 

As mentioned above, establishment of key inventory 
parameters, or knob setting, also is dependent upon the 
MARK classification of an item. Figure 4 illustrates the 
MARK classification system. The MARK system classifies 
inventory items based upon demand pattern and unit costs. 

An item with little or no demand would be designated MARK 0, 
while an item with low cost but fast moving demand would 

be designated MARK II, etc. Repairable items are all 
treated as MARK II AND IV items for UICP calculations. 

The UICP models for calculating economic order quanti- 
ties (EQQ) and reorder points are, in general, modifica- 
tions of classical inventory formulations as discussed in 
Hadley and Whitin [Ref. 5] and implemented into the Depart- 
ment of Defense by [Ref. 6]. The following discussion will 
Cutline the equations used by the Levels program. The 
derivations of the models are presented in [Refs. 7, 8]. 

The repairable procurement model attempts to minimize 
the variable costs associated with holding inventory. 

These costs are the ordering costs which include the 
Bopmitetrative Cost of placing an order; the holding cost 


Timewmeimeitdes Opportunity cost of capital, obsoles¢eence 
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and storage costs; and shortage costs. The shortage costs 
are the costs to the supply system of being out of stock 

for an order. While in the closed military supply system 
this cost is not quantifiable in terms of dollars and/or 
material readiness, a shortage cost is imputed as a result 
of the budgeting process. The initial calculation is the 
standard Wilson EOQcalculations, Q,. (modified appropriately 


for the repair problem) of 


oe 8 A (D - B) 
W Gane 
where: A = ordering costs, 
B = repair reqenerations, 
C = replacement cost for the item, 
D = recurring demand for the item, and 
I = holding cost rate. 
The "8" in the equation transforms the calculation into a 
yearly cost since the input variables D and B are quarterly 
rates. The calculation (D-B) represents "attrition" 
demand, or the anticipated recurring demand observations 
that cannot be filled by the repair process. B is the 
product of the carcass return forecast and the repair 
Survival rate. The repair survival rate (RSR) 1s an 
estimate of the percentage of carcasses entering the repair 


process that will survive and be placed in "A" condition by 
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the DOP. Thus, through the parameter B, the carcass return 
forecast (CRE) plays a key role in the determination of the 
Seeger Quantity. if the CRF is too high, projecting that 
more carcasses will be turned in by customers than will 
actually be the case, then the EOQ quantity will be too low. 
This will cause too few RFI units to be procured and possi- 
bly result in a not-in-stock position. This will drive 
SMA down and force repairs on existing carcasses at premium 
prices in terms of both unplanned repair contracts and high 
priority transportation costs. Alternatively, if the CRF 
is too low, more carcasses will be returned than estimated. 
This results in a long-supply position due to inflated buy 
@UantLteies and greater than expected carcasses returned. 
While SMA should be high in this situation, the penalty 
cost will be an excessive investment in inventory and 
associated greater than necessary holding costs. 

The Levels program does not automatically make the 
EOQ value the buy quantity, but imposes several constraints 
on the quantity to protect against inordinately large or 
small buys. This guards against possible obsolescence on a 
long supply position and an increased purchasing workload 


for small EOQ's. The actual buy quantity, Q*, is determined 
Oama—evie (1, (D - B), Min (Q,, 12 (D -— B))). 


The reorder point (RP) is taken to be the sum of the 


procurement problem variable and a safety level. The 
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procurement problem variable, 2, represents the net assets 
(RFI) required to meet anticipated recurring demands over 


the procurement lead time period. It is calculated as 


Z= (Dx L) - (B x L) + (B x T) ' 
where: 2Z = procurement problem variable, 
L = procurement lead time in quarters, 
T = repair turnaround time, 
D = anticipated recurring demand per quarter, and 


B = repair regenerations. 


The safety level is a function of risk and the variance 
of the procurement problem variable. 
Risk, as used in the UICP repairable model, is defined 


ass 


* 
RISK = foe Oa ee ’ 


(Ose lee Det (4 XX EF (D = B)) 


where: E = military essentiality weight, 
F = mean quarterly requisition forecast, 
QO*= constrained order quantity, and 
h = assigned shortage cost per requisition. 


This is the UICP approximation of the classical inventory 
model of risk which yields the probability of running out 
of stock over the procurement leadtime period. The CRF is 


Bepresented in the risk calculation in the repair 
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regeneration factor. If the risk factor is low, the reorder 
point will be relatively high resulting in frequent reorders 
and a high safety level. If the risk factor is high, a 
relatively low reorder point results with a small safety 
level. If the CRF is low (more carcasses are returned than 
expected) the risk factor will be smaller than it should 
be. This causes reorders to occur more frequently than they 
should thus leading to a higher investment in safety stock 
than would be actually necessary. On the other hand, a CRF 
that is too high would result in the opposite situation of 
a dangerously low safety stock level and probable stockouts. 
The other repairables inventory control calculations 
made by the Levels program are the economic repair quantity 
(ERQ) and the repair level, both similar to EOQ and reorder 
quantity. The UICP system, however, considers the repair- 
able EOQ and ERQ problems as separate entities and the 
calculations are "uncoupled", i.e. the calculation of one 
does not affect the calculation of the other. The repair- 
able EOQ model, in fact, assumes that the CRF will indeed 
be accurate and the inductions into the Repair Phase and 
the subsequent regenerations at the end of the repair cycle 
will occur on time with certainty. 
The ERO is determined as a function of the variable 
Sestomeavolyed in repairing a carcass: cost to place a 
repair order, holding costs per unit, and backorder costs 


when there is a shortage of RFI assets and is subject to 
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several system constraints. A formulation similar to the 
Wilson EOQ model is used to obtain the approximation of the 


repair quantity, oat 





8 A. Mane (D> 2B) 
eC 
a 


where: Cy repair cost for an item, and 


Ar cost to initiate repair action. 


Note that the repair quantity equation takes on a slightly 
different form. If the forecasted demands are less than the 
forecasted repair regenerations, the forecasted demand 
figure will be used in the ERQ calculation and there would 
be no purchase of new units Since repair will be able to 
meet all expected demands. If the forecasted demands 
exceed the expected number of repair regenerations, B will 
be used, and there should be a resulting procurement action. 
Because of the economics of placing repair orders and/ 
or repairing too many carcasses at one time (again possible 
obsolescene), there are constraints placed upon ERQ by the 


Levels program. 


ERQ = Max (1, Ree <8) ; 


Qwr! 


where: Q., = optimal Wilson ERQ determination above, 
and 
RVC = repair cycle length in quarters. 
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The repair level represents the predesignated carcass 
inventory level that should trigger a repair order being 
placed for a quantity of ERQ units to preclude running out 
of stock. This level is a function of the mean and variance 
of repair turnaround time and the assumed probability 
distribution of repair leadtime and risk. The repair 
turnaround time mean and variance parameters are determined 
by the Levels program from historical data. The probability 
distributions used are the three previously mentioned. 


Risk in the repairquantity calculation is determined by 


x 
ee i ee D 


a a el CD) + (4) ae EB) 


where: Q;* = ERQ. 


m@nme carcass return forecast can cause problems in initiating 
repair inductions. When the CRF is too high, the risk will 
be relatively lower. This means a higher repair level. 
Since the repair order will not be initiated until that 
level is reached, an order will be delayed awaiting needed 
carcasses which are returning at the actual lower return 
rate. This may result in the repairable pipeline "running 
dry" before more carcasses are inducted with the resulting 
Shortfall in RFI assets from the repair cycle. If the CRF 


is too low the opposite effect will occur with more money 
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money being spent on repair than is necessary to maintain 


the desired SMA. 


F. SUPPLY DEMAND REVIEW 

In order to implement a "continuous review" model in an 
inventory system, the system's assets and requirements must 
be tracked. This is accomplished within the UICP system by 
the Supply Demand Review (SDR) B10 program. The Levels 
program provides the reorder levels and reorder quantities 
as inputs to SDR. Besides the reorder quantity and reorder 
level for an item, SDR requires two other parameters - 
total assets and requirements. Total assets for an item 
include current on-hand and anticipated due-ins within the 
procurement lead time from both repair (which includes 
forecasted carcass returns) and procurement sources. Total 
requirements include planned program requirements, war 
reserves, anticipated recurring demands and backorders due- 
out during the procurement cycle. SDR compares assets 
against requirements to determine the net asset position. 
If the net asset position is at or below (asset deficiency) 
the reorder point, a buy recommendation is initiated. This 
buy quantity is the economic order quantity plus the asset 
deficiency quantity. SDR is run approximately once a week. 
It does not review the asset position of every item on each 
run, but only the items flagged by the TIR program BO4. 


BO4 compares the SDR reorder point to the item asset 
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position as determinec Erom the MDF and PPR Files and flacs 
the candidate items for vorocessing bv SDR. 
SDR buy mputations can be run in two modes, live or 


deacd. A live SDR buy recommencation is automatically 

routed to procurement for action unless the item manacer 
manualiy overrides the svstem. If a dead SDR is mace for an 
item, the buy recommendation is routed to the item manager 


who must then decide if the buy should be submitted to 
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procurement. In general, the mode is ¢ 
constraints. SDR also determines the allocation of the 
DuY cWantitzes and/or redistribution of existing stocks 
amonc the stock points. The SDR procedure is crapnically 
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G. REPAIR SCHEDULING 
The repair levels and ERQs determined by the Levels 


arameters for the Reva} 


ry 


program are used as the decision 


tS 


Some@uling procram B08 which also accesses the MDP, PPR 
ae BBE tiles Tor its data base. BOS is run about every 
two weeks and makes a computation ci its asset pcesition to 
Compare to the repair level similar te the computation in 
the SDR process. BO8 then makes its repair incucticn ana 
redistribution recommendation about NRFI material. 
the Repair Scheduling vrogram senses that the system is 
carcass constrained (short), it aiters tne Movement 


Priority Designator (MDP) in the MDF. This eventualiy 
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perggers a Change in the MRIL which the customer uses to 
Peecmmume Ehe transportation priority for the carcasses 


moon turn-in. 


H. REPAIRABLES FUNDING 
Before considering the repairables funding requirements 

through the budgeting process of the UICP Stratification 
program B20, it is important to understand the fiscal 
structure currently associated with repairables. The Navy 
divides its material stocks into two major classifications 
as defined by Wooten [Ref. 10]: 

Principal Items are major assemblies such as aircraft 

engines, complete radar sets, gun mounts and ammunition. 

Acquisition of this material is funded by the procurement 

appropriations - such as OPN, WPN, and APN. 

Secondary Items are Spare parts, replacement assemblies, 

and consumable supplies. Examples are tools, repairable 

assemblies, hardware, fuel, clothing and the like. 
Principal items are funded through the appropriations cited, 
while secondary items are funded through two possible 
sources. Traditionally, all repairable items were funded 
by the appropriations accounts that also buy principal 
items. The other source of funds for secondary items 1s 
the Navy Stock Fund (NSF). 

The NSF is a revolving fund managed by NAVSUP. This 

means that the NSF consists of money and/or stock owner- 
ship. When stock is issued to customers, the stock portion 


of the NSF is reduced and the funds portion is increased by 


an equal amount. These funds are then "available" through 


ay 





the budgeting process to the ICP or stock point to purchase 
more stock from vendors. This increases the stock in the 
account and reduces the available cash balance. While in 
theory this is a closed system, there are losses to the NSF 
which are the result of material loss, pilferage and 
transportation charges. These financial losses are made up 
through surcharges on customer sales. The congressional 
budgetary process provides the infusion of funds when the 
NSF operating base is increased due to an enlarged scope of 
Seerations. Such an infusion of funds occurred on 1 April 
1981 when non-aviation depot level repairables managed by 
SPCC were changed from APA funding to NSF funding for a 
three year test period. APA, or Appropriations Procurement 
Account, funding means that the repairables were procured 
with funds appropriated annually from the major budget 
claimants and were essentially free to the repairable item 
end users. Figure 6 depicts the repairables within the NSF 
PAnGwemMe picture . 

Funding repairables from APA appropriations requires 
annual budget submissions which are followed by a fixed 
POpeEepriation to be spent in the designated fiscal year. 
Under the new system of NSF funding, repairable budgets 
are also submitted to the NSF manager, NAVSUP, but they 
Peemimeternms of the obligation authority required to 


execute an NSF funded operation. The approved NSF budget, 
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called an approved apportionment, is provided to the 
recipient in terms of estimated customer NSF sales, NSF 
obligation authority of the recipient and a deviation (the 
difference between anticipated sales and obligation 
authority). NAVSUP then issues the apportioned funds in 
quarterly allocations. 

There are significant advantages of NSF funding over 
other methods of funding in the repairables area. First, 
the NSF budget holder can obtain additional obligation 
authority 1f sales exceed the anticipated levels originally 
estimated. The only limitation is that the budget holder's 
apportionment can be increased only up to a level where 
there is still the original deviation between obligation 
authority and the new sales figures. The NSF obligation 
authority augmentation procedure 1s therefore simpler than 
an augmentation request to a specific appropriation account 
because the justification is automatically provided by 
increased customer sales. The second distinct advantage of 
NSF funding of repairables is that the ICP is allowed to 
decide how to allocate the obligation authority between 
repair and procurement. Under the appropriation funding 
procedures, there are separate appropriations for repair 
and purchase. Therefore, if the CRF is too large when the 
funds are originally requested, there could be a large 
reserve of repair money with few carcasses to repair (again 


carcass constrained) with the purchase funds exhausted 
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early in the fiscal year. If the CRF was too small the 
SePpesice Situation would occur. 

The change in funding of repairables also affects 
customers from a financial point of view. Prior to 1 April 
1981, all non-aviation DLR's were "free" to the customer 
because of the APA funding. After that date customers were 
required to pay for RFI units with appropriated funds. 

The benefits expected to be derived from the DLR-NSF 
Bese are: 


(1) improved supply readiness because of more 
budgeting flexibility, 


(2) improved carcass turn-in rates, 
(SJemere tamely turn in of carcasses, 


(4) reduction in inventory investments due to 
improved carcass availability, and 


(5) higher fill rate of entry point repairable item 
requisitions. 


Items (4) and (5) are natural consequences of improved 
carcass turn-in rates. This is to be accomplished through 
a two-price system for repairable requisitions and an 
improved carcass tracking program. When a customer submits 
a requisition for a repairable item, he will be charged a 
qWeueerree waien 1S based upon the repair cost of the itam. 
Miemwaecwealece runs approximately 25-30 percent of the 
replacement price. If no carcass has been received from 

an activity seventy-five days after the initial requisition 


fama inGuiry Ls sent to the customer by the ICP. If 





there is not satisfactory follow-up action by the customer 
Or carcass turn-in within twenty-one days after that, the 
charge to the customer is increased to a full replacement 
price plus the NSF surcharge cost. This is known as the 
standard price and is also charged to a customer who does 
Peouedave a2 Carcass to turn in initially for a recurring 


demand. 


i STRATIFICATION 

The UfCP Stratification (or Strat) program B20 deter- 
mines the budgetary requirements necessary to support the 
UICP wholesale inventory system. For the repairables 
operation, B20 estimates these funding requirements as a 
function of key inventory control variables such as demand 
forecasts, carcass return rates, RSR, repair prices, 
replacement prices, procurement lead times and assets 
available over a two year time horizon. This process then 
determines the funds required to support the available 
assets and to procure the replacement units needed to fill 
the gap between assets and requirements. Strat is run in 
March and September every year to coincide with the budget 
cycle and provides the baseline for the procurement and 


repair budgets submitted by the ICP. 


ow) CONCLUSION 
The above discussion has highlighted the critical role 


of the carcass return forecast in the repairables inventory 
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control process. The CRF is at the base of both procurement 
and repair levels computations. While the CRF is only a 
forecast or "best guess" of anticipated carcasses returning 
to the repairables cycle, it 1s important that the forecasts 
accurately reflect the actual returns. The thesis will now 
present various forecasting schemes and tests of their 


effectiveness using actual SPCC data. 
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tii. THaeeMOvErS 


The criteria for a good forecasting method is that the 
model closely follow actual observations and quickly adjust 
to trends. To do this the model should be closely aligned 
to the actual underlying process that generates the observed 
values. To select the appropriate forecasting model, 
Chambers, Mullick and Smith [Ref. 12] suggest that the 
following factors be considered: 

a) the relevance and availability of historical data, 

b) the degree of accuracy desired, 

c) the time period over which to forecast, and 

d) the cost/benefit of the forecast to the system. 
The main consideration is to make the best use of available 
data. For example, the best forecasting technique available 
may be prohibitively expensive because of the cost of re- 
structuring the data collection, storage and retrieval 
systems. Or the best forecasting method may require non- 
existent information. 

The forecasting technique should be one that achieves 
system-wide inventory objectives at minimum cost. These 
costs would consist of the cost to collect the data and 
actually make the forecast, cost of holding inventories, 
distribution system costs, the cost of running out of stock, 


Seecwumtnese costs are difficult, if not impossible, to 
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collect and identify in a study of this scope. Therefore, 
the only MOE's used in this study deal with forecast error 
measurement. We assume that small forecast errors are 
consistent with a high level of system supply effectiveness. 
Also, the cost of data collection and storage used for each 
technique is not addressed. 

This study considers two types of models: autoregressive 
and causal. An autoregressive model as defined by Makridakis 
and Wheelwright [Ref. 13]: 

..-.-1S a form of regression, but instead of the dependent 
variable (the item to be forecast) being related to 
independent variables, it is related to past values of 
itself at varying time lags. Thus an autoregressive model 
would express the forecast as a function of previous 
values of that time series. 
A causal model is defined by Chambers, Mullick and Smith 
[Ref. 14] as a "model of the system which captures the facts 
and logic of the situation." The following two sections 
will deal first with the autoregressive models and then the 
causal models. 

Because of the availability of only eight quarters of 
data from the IHF, the models are examined over that period 
Sfetimes Ene first four quarters are used to generate 
FaaeinoeGcenailtlons. This obviously limits the models that 
can be used. Because of the brief amount of data available 
to develop the model parameters and to analyze forecasting 


effectiveness, all results of this thesis have to be viewed 


with caution. The results should serve as the approximate 
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worth or relationship of the forecasting methods on the 
Particular data used. The short time horizon also limits 
the models that are available for analysis. Time series 
models like Box-Jenkins, for example, cannot be used. 

One further assumption in the use of the following models 
and the study in general is that the recurring demand fore- 
casting (RDF) technique is reliable. The UICP RDF model 
used by SPCC is an exponential smoothing model with filters 
(the same model as described below for carcass return 
forecasting). The UICP RDF method is discussed in [Refs. 


iy, 16). 


A. AUTOREGRESSIVE MODELS 
ime ce exponential Smoothing (SPCC) 
The model for forecasting carcass returns currently 
in effect in the UICP system is exponential smoothing with 


Eeltering., The model is: 


CRF, = ax (ACR 


1 f 


where: CRF, 


ACR, 


carcass return forecast for period t, 


actual carcass returns for period t, and 


smoothing constant. 


The forecast for item i for period t is a convex linear 
combination of the observed carcasses returned in period t-l 
and the forecast for period t-l. This method allows the 


most recent observations to play a key role in forecasting a 
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new value while relying upon the steadying influence of past 
performance brought forward through the previous forecast. 
When the new forecast is generated, it replaces the previous 
forecast. One characteristic of pure exponential smoothing 
models is that the forecast is slow to catch up with current 
trends or shifts in the pattern of carcass returns because 
of the weight of past performance on the forecast. The SPCC 
model includes filters to make adjustments to the forecast. 
Pre calculations that are used in the filtering pro- 


cess are also determined through exponential smoothing. 


MAD, =a x |ACR, ~ CRF,| + (l-a) x MAD 


t t| t-1 


where: MAD = mean absolute deviation for period t. 


Theoretically, when the population of observations comes 
from a normal distribution the mean absolute deviation para- 
meter (defined as an expected value) is approximately 1.25 
times the standard deviation. It measures the expected 
absolute deviation of actual carcass returns from the mean. 
In the SPCC model the mean is replaced by the CRF and 
expected value is estimated by exponential smoothing. The 
first filter looks for excessively large or small 

Besee ations. Limits are set up around the carcass return 
average or CRF. These limits are six standard deviations 
SpeeeeeoeveaD. tf the observation for a particular quarter 


is outside these boundaries, that observation is not used to 


47 








compute a new CRF, the previous CRF is retained without 
Change (in effect the smoothing constant is set to zero). 

If the observations are outside the limits in the same 
Seeseetion (either high or low) for two consecutive quarters, 
a step increase calculation produces the new CRF: 


BGR 3 + ACRE, 


e 2 


and a new MAD is calculated from the equation 


MAD. = 1.386 x (crF )*/?® 


+ ) 


ie 


New control limits are established in the following quarter 
and the procedure continues. 

A second type of filter in the SPCC model detects 
trending, or the tendency of the carcass return observations 
to be either increasing or decreasing. Trending is tested 


with the following ratio: 


2.x (ACR,_, + ACR,_,) 


aaa ee | 
cae wer, _, + ACR__, * ACR, 


Lf the ratio is within the limits [0.9, 1.1], the smoothing 
Somstameme 1S set to 0.1. Otherwise a = 0.3. This allows 
the most current observations to have a greater influence on 
GacwGeE eo 8Whale the CRF will still lag behind an actual 
EReneewatned = 0.3, the CRF will catch up at a faster rate 


than when a = 0O.l. 
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Beeause Only the current CRF is retained by the UICP 
system, the SPCC exponential smoothing with filtering pro- 
Gram has been included in this project to recreate the 
Behecases Over the two year period this study covers. The 
program written with the above guidelines to produce the 
SPCC forecasts is called TSPCC Fortran. 

2. Exponential Smoothing (ES) 
This model is similar to the UICP exponential smooth- 


ing model except that no filtering is involved: 


Saree ¢ xX ACR 


t an + (l-a) x CREF : 


eae 


where: CRF 


e Cancass return tomnecast foruperiod t, 


ACR, = actual carcass returns for period t, and 
= smoothing constant. 
This model was programmed as TES Fortran. The simulation 


Teoeouinecor a complete cycle through the eight quarters for 
each value of the smoothing constant a ranging from .05 to 
1.0 in increments of .05. This was done to provide an 
indication of which weight a did the best job overall 
considering the actual SPCC data. 

When a = 1.0, the previous observations are elimi-~ 
nated from playing any part in the forecasting scheme. This 
method is known in the literature as the "naive" forecasting 


metnod where: 


CRF, = ACR, _ 


rc he 
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3. Moving Average (MA) 

The moving average forecasting model considers only 
the past n quarters and gives equal weight to each 
observation. Unlike the exponential smoothing, the moving 
average model is not affected by all past observations, 


but truncates the historical data at a predetermined point. 


n 
E. ACR, _; 
CRE, = 5 ; 
where: CRF -eCtuedas Celli tOneecast 1 spemtoqumt, 


ACR, = actual carcass returns in period t, and 
n = number of past periods included in the 
calculation. 
The program written to produce moving average forecasts is 
TMA Fortran. The model was run with n = 2, 3, 4. The fewer 
the number of quarters averaged, the more easily a trend can 
be captured. Conversely, 1f a single observation is an 
outlier or incorrect, it has a dramatic effect on the 
forecast. According to Makridakis and Wheelwright [Ref. 17], 
“the more the randomness, the longer (should be) the moving 
average." This argues in favor of a longer period being 
taken into consideration in the averaging process. 
4. Moving Least Squares (MLS) 
The moving least squares forecasting model is 
Similar to the moving average model in that the current 


pomeGast 1S a function of the last n time periods. The 
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difference is that each point is not given equal weight, but 
combined by means of the least Squares method. Then the 
least Squares line is projected one quarter beyond the input 
data to arrive at the forecasted value. The algorithm for 


the moving least squares method is: 


CRF. mat (5 xs t) 


where: CRF carcass return forecast in period t, 


il 


constant or intercept term, 


oi 
i 


slope of regression line, and 


ct 
Il 


period number to be forecast. 


The input to the least squares formulation to obtain the two 


parameters is: 


x ¥ 

1 ACR, 
2 ACR> 
n ACR, 


where X is the explanatory variable and Y is the dependent 
variable. The n represents the number of periods included 
in the calculation. For example, if the method was pre- 


dicated upon the previous four quarters, n would equal 4. 


Sel 





Once the least squares line has been determined, the fore- 
cast is obtained by setting t = n+1. The parameters for 


the least squares procedure are determined as follows: 





n n n 
* be, (X, x ¥ 3) — i? x eS ¥5) wna 
1=1 a 
n n 
a” 2, Y, - BX (2 x 
n 


Makridakis and Wheelwright [Ref. 18] discuss the least squares 
approach: 
This approach to estimating the parameter values in an 
equation minimizes the squares of the deviations that 
result from fitting that particular model. For example, 
1f a trend line is being estimated to fit a data series, 
the method of least squares estimation could be used to 
minimize the mean squared error. This would give a line 
whose estimated values would minimize the sum of squares 
of the actual deviations from that line for the historical 
data. 
The model was run with n = 2, 3 and 4. One advantage of this 
method is that it detects trends rapidly. This, however, 
could be a drawback if some of the data points were spurious. 
The larger the value of n, the slower the least squares model 
will be to recognize new trends and the less sensitive the 
model will be to bad data. 
tie wectOgram Written to calculate the least squares 


forecast is TMLS Fortran. An example of the moving least 


Squares method is provided as Appendix A. 
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Dec oapelve Response Rate (ARR) 
The adaptive response rate model is suggested by 


Makridakis and Wheelwright [Ref. 19]: 


Adaptive-response-rate single exponential smoothing 
(ARRSES) has an advantage over Single exponential smooth- 
ing — it does not require Specification of a value for a. 
This characteristic is particularly attractive when 
several hundreds or even thousands of items require 
forecasting. Additionally, this method can change the 
value of a, On an On-going basis when changes in the 
pattern of the data have made the initial a value no 
longer appropriate. ARRSES is adaptive in the sense that 
the value for a will change automatically when there is 
a change in the basic pattern requiring a different a. 


This particular method appears suited to the SPCC forecast- 
mq sttuation with such a variety of items managed. The 


algorithm for the adaptive response rate model is: 


Che =omecwAcR, + (1 —- a)ex- CRE 








tt+l se ie se c 
mwa th: 
a 
cae 7 

t+l Be | 
BE, = 5 xe, + le 8)) x Ey ’ 
M, = — oom ey ee h=" 8) x Mea ' 
e, = ACR, = CRE ; 
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Witetoe oRP) = Carcass return forecast for period t, 


e 
ACR, = actual carcass returns for period t, 
a, = smoothing constant for period t, 
a MereCaoe Crror Lor period t, 
EY =BoMeoueleod LOLecase error £Or period t, 


M, = absolute smoothed forecast error for 
period t, and 


Be-ssmOOothIng Constant for error Eerms. 


There are two smoothing constants in this algorithm, a and 
8. For this model 8 was arbitrarily set to .2. The other 
smoothing value fluctuates dynamically as described above. 
This model is predicated on a being allowed to vary based 
upon the performance of the previous forecasts thus adjusting 
for trends. The adjustable characteristic of a makes this 
model different from the exponential smoothing model, and, 
in a sense, performs a filtering of the data. One drawback 
is that more information must be stored in computer memory. 


The program written for this model is TARR Fortran. 


B. CAUSAL MODELS 
1. Regression 
The regression forecasting models tie carcass 
returns (the dependent variable) to a collection of explana- 
tory variables (the independent variable) such as past period 


recurring demands. The algorithm takes the familiar form: 
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Y= BX + u ; 


where: Y = dependent variable vector, 
X = independent variable matrix, 
8 = coefficients vector, and 
u = stochastic disturbance vector. 


The estimating technique used is multiple linear regression. 
This produces maximum likelihood estimators for the model 
coefficients when it is further assumed that the stochastic 
disturbance vector u is distributed as the multivariate 


normal with zero mean and covariance matrix %, i.e. 


Ee ee =eNiG), O- Ts 


With this model and the above assumptions concerning the 
stochastic disturbance term and non<-stochastic X terms, the 
coefficients are derived in accordance with the Gauss-Markov 
Theorem. As Intriligator [Ref. 20] points out, the coeffi- 
cients “are linear and unbiased estimators that are the 
best of all linear unbiased estimators; i.e. the estimators 
have minimum variance within the class of linear unbiased 
estimators." 

MHiemMeGertLiciente vector solution becomes: 


A ae 
pee Ke XY. 


The carcass return forecast, Y, is taken to be 


rs gat 





The regression model (coded as TREGRESS Fortran) was 
used with two different types of explanatory variables, 
recurring demands and requisition advice codes. All regres- 
Sions were run on the IBM 3033 VMS batch processing system 
uSing the Statistical Analysis System (SAS) to accomodate 
the large X data matrix (30,044 x 2). SAS allowed the 
regressions to be calculated with or without intercepts, 
ana it provided Re, Standard errors of regression, Durbin- 
Watson statistics, t-Statistics and various other statistics 
that are helpful in evaluating regression models. 

a. Recurring Demand Regression Models 

The first set of regression models uses aggre- 
gate demands per period as the independent variable. The 


general model is: 


CRE, mane oot 8, RDF - S5ARD,_j ar 8,ARD,_» steel erties tio 
where: CRF = carcass return forecast in period t, 
RDF, = recurring demand forecast in period t, 
ARD, = actual recurring demand in period t, 
oe = intercept term (when included), and 
35 = weighting coefficient for the ith 


independent variable. 


As discussed in the introduction, a carcass 
return does not occur unless there is a demand (l.e. a unit 
has failed thus setting the repair cycle in motion). The 


date of the demand and the receipt of the carcass, however, 
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do not necessarily coincide. The carcass could be turned in 
with the requisition for the replacement item or turned in at 
some later date. This is the relationship that the regres- 
sion model attempts to identify. The situation is further 
complicated by the fact that not all carcasses are turned 
back in to the system. Therefore, the cumulative total of 
carcass returns over time should be less than 100 percent 

of total demands over that same period. 

It 1S important to note that some carcasses are 
turned in with the demand. This means that a carcass return 
forecast for period t should include some carcasses that 
resulted from actual demands also in period t. Since the 
demands for period t are a random variable, they must be 
forecasted as an input to make the CRF model work (where the 
coefficient of the current quarter explanatory variable is 
other than zero). When those resulting regression models 
were synthesized, the recurring demand forecast was used to 
estimate carcass returns for the current period. The recur- 
ring demand forecasting scheme used was the UICP model SPCC 
currently employs. This model is identical to the exponen- 
tial smoothing with filtering model used by SPCC to calculate 
carcass returns. 

The regression model for forecasting carcass 
returns based upon recurring demand was suggested by SPCC 
Code 340 and was proposed by SPCC Code 346 as an "offset" 


model. 
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b. Advice Code Regression Models 

The regression model was also used to investi- 

gate the use of advice codes as explanatory variables. 
Each requisition has an advice code which provides amplify- 
ing information on the transaction. The advice codes that 
apply to recurring demands as defined below are taken from 
freer. 21). 
5A - Replacement certification. Requested item is 
required to replace a mandatory turn-in repairable 
which has been surveyed as missing or obviously 
damaged beyond repair. 
5G - Exchange certification. Requested item is a 
mandatory turn-in repairable for which an unservice- 
able unit will be turned in on an exchange basis under 
the same document number as that used in the 
requisition. 
5S - Remain-in-place Certification. Requested item is 
a mandatory turn-in repairable for which an unservice- 
able unit will be turned in on an exchange basis after 
receipt of a replacement (serviceable) unit. Turn-in 
will be on the same document number as that used in the 
replacement requisition. 
5X - Stock replenishment certification. Requested item 
tomiGgecqutred £Or stock sxeplenishment of a mandatory turn- 
in repairable for which unserviceable units have been 
Or will be turned in for repair. 

To summarize, the 5A advice code means that the 
requisition does not have a turn-in. These demands will not 
be included in the explanatory variable matrix since they do 
not account for any carcass returns. 5A requisitions 
represent a portion of the recurring demands used in the 


previous regression model that do not generate a return, 


Biiicmpasa Ot: the Cause @£ the ratio of carcass returns to 
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recurring demands being less than one. Advice code 5G 
indicates that a carcass will be returned at the same time 
the requisition is submitted. While this does not always 
occur, the majority of 5G carcasses should return within one 
period of the original demand. The 5S advice code indicates 
that the failed part will remain installed in the next 
higher assembly which will continue to work in some degraded 
manner until the replacement item is received. At that time 
the failed unit will be pulled from the assembly and returned 
to the supply system. The 5S advice code item then essen- 
tially assumes the turn-in pattern of normal advice code 

5G requisitions. The fourth advice code, 5X, indicates 

that an intermediate level maintenance facility (e.g. a 
tender or shipyard) has issued the repairable item from its 
inventory to the customer and that it is ordering to replace 
the stock. The 5X, in effect, “masks" the true recurring 
demand advice code which cannot be determined from the 5X 
requisition. This creates two problems. One is that the 
Garcass return could vary from no returns to all (1.e. 
Original demand was 5A) to a long wait for the carcass 

(i.e. original demand was 5S). This makes the carcass 
tracking program very difficult to implement for 5X demands. 
The other problem is that the original requisitioner turns 
the carcass in to the supply system citing the document 
PUMP motets BbequiSition. The facility that issues the 


item to the original requisitioner reorders the item for 
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stock using its own requisition number citing advice code 5X. 
Therefore, the requisition number in the ICP due-in file 
created as a result of the stock replenishment action and 
the requisition number on the actual turn-in item do not 
match. Thus, the issue and subsequent carcass receipt can 
not be properly paired nor the turn-in waiting times 
definitely established. 

The purpose of regression analysis is to identify 
the underlying relationship of demands by advice code to 
carcass returns. Figure 7 illustrates the time-lag layering 
effect of the carcass returns as a function of recurring 
demands with a mix of advice codes. An example of the 
regression model relating carcass returns to demands by 


advice codes 1s 


CRF, = 8, + 8) F5G,_, + 83A5S,_3 + 8,A5S,_, + BaASX._3 +... 


i 3 4 3 
where: CRF = Carcass return forecast for period t, 
F3G, = forecasted advice code 5G demands 1 
BEELOG tc, 
ASG, = actual advice code 5G demands in period t, 
ASS, = actual advice code 5S demands in period t, 
ASX, = actual advice code 5X demands in period t, 
ee = intercept term (if applicable), and 
35 = coefficient for the ith advice code demand 


in ere od “tik. 
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Figure 7. Theoretical Time-Lag Layering Effect of Carcass 


Returns as a Function of Demands by Advice Code. 
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eee lag eAG) 

The time-lag model uses the cumulative distribution 
of carcass returns to predict the number of carcasses return- 
ing in any one period. The key element of this approach is to 
identify the proper distribution of carcasses returning to 
the system. Information concerning carcass turn-in times 
has already been collected from the SPCC THF file for a study 
of the proposed NSF funding of DLR items. The appropriate 
information from [Ref. 22] is contained in Figure 8 and used 
to determine the desired carcass return distribution. The 
data from [Ref. 22] was collected under the following 
specifications: 

Data for constructing the distributions were extracted 
from the SPCC Transaction History File for the period 
November 1975 through October 1977. The time measured 
is the time between the Julian Date of the document and 
the transaction date of the TIR. Identification by 
Atlantic, Pacific and Shore was determined by the Service 
DeSignator Code of the document. As a result, any ship 
issue or turn-in document which was initiated with a 
Service Designator Code of "N" is compiled under "Shore." 
Carcass returns were identified by Condition Code "F" in 
the document. Condition Code "A" turn-ins are contained 
in "Other Returns." Although a distribution of turn-ins 
Eveemtoriiy Was COnNStructed, very few of the TIR's for 
turn-ins contained a priority designator. 
For the purpose of this study, the cumulative totals of 
returns by all Service Designation Codes was used because no 
such distinction is made by the SPCC forecasting models. The 
data on "Other Returns" was not used. 


In order to build the model, the assumption was made 


that the demands within each of the periods listed in Figure 8 
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are distributed uniformly. Therefore, the average demand 
eccurs on the 45th day of the quarter. If a demand occurs 
very early in the quarter there is a greater chance that a 
carcass will be returned within the period than if a demand 
occurs at the end of the quarter. These two situations 
would tend to net out to the 45 day average available period 
during the quarter the demand was originally recorded under 
the uniform demand occurrence assumption. The cumulative 
Sstrlbutcion fLunction of carcass return waiting times will 


be partitioned into the following segments: 


QUARTER ELAPSED DAYS 
1 OF a5 
2 ee hates WS >, 
3 SO 
3 Zoe eS 


Figure 8 does not break at the above "Elapsed Days" 
end points. The assumption concerning uniformity is again 
invoked to average the cumulative distribution over the 
periods in Table I to obtain an estimate of the cumulative 


Peemealtitty at the points 45, 135, 225 and 315. 


PER EOD DAY CUM PROB DIPPER ener 
ip 45 Popo 2 oe 
2 3S Bes GaN! 7) m2] 
3 225 oOo e .0798 
2 Bales 7G 'G .0361 
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Given a recurring demand in period one, the difference column 
above can be interpreted as being the probability of receiv- 
ing the carcass back in that same period, the following 


period and so on. This leads directly to the time-lag 


model: 
CRF, = .5584 RDF, sees ARD,_y 07.918 ARD, _» - 
OU ScH ARD,_3 ; 
where: CRF = carcass return forecast for period t, 
RDF = recurring demand forecast for period t, and 
ARD, = actual recurring demand for period t. 
The model accounts for only approximately 97 percent 
of the carcass returns. Because of the four quarter baseline 


constraint of this study, the model could not include terms 
beyond t-4. The inclusion of a forecast for recurring 
demand for the current quarter follows the logic and discus- 
Sion presented in the regression model. The program used to 
synthesize this model was TREGRESS Fortran and utilized the 
SPCC exponential smoothing with filter procedure for fore- 
casting recurring demands. 

There are two caveats for this model. First, the 
model assumes 100 percent carcass returns per demands. The 
model only addresses time between the occurrence of the 
demand and the carcass return and not the possibility that 


there may be no carcass returned for a particular demand. 
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The other caveat is that the study was conducted before the 

introduction of NSF funding of repairables. That change, 

coupled with the improved carcass tracking program, could 

alter lags between recurring demands and carcass returns. 
3. Demand/Return (DEMAND) 

Another model analyzed in this thesis was formulated 
by SPCC Code 790 and setsS carcass returns as a function of 
demand. This approach also incorporates the concepts of 
repair survival rate (RSR) and wearout rate (WR) into the 
forecasting procedure. According to [Ref. 23] the repair 
survival rate is "the percentage of those carcasses that 
enter the repair process that are returned to RFI condition." 
Mee Rok LS Currently calculated at SPCC through an exponen- 


tial smoothing process: 


JUNIO eee en Gls’ 


ie t 
a a ie a _ 
RSR, Cer IND, er Cyr RSR,_y ; 
where: RSR, = repair Survival rate in period t, 
IND, = inductions into the repair cycle in 
perlod. E; 
SUR, = surveys from the repair cycle in 
period t, and 
a= smecrming constant. 


Maemwearout rate is defined by [Rez. 24] to be: 


MEME scuLe of the 2raction Of units that 1s not expected 
to survive repair. Unlike the Repair Survival Rate, the 
Wearout Rate considers not only disposals during che 
repair process but also disposals made prior to the ship- 
ment of carcasses to the repair facility. In other words, 
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disposals made at the intermediate level are included in 
the computation of Wearout Rate. At SPCC, Wearout Rates 
are estimated or computed manually and entered into the 
computer by the technical personnel. 

The model is motivated by the fact that the UICP 
system forecasts recurring demands and carcass returns 
independently, and the UICP system was designed under the 
assumptions that all DLR's would be turned in by customers, 
and that all DLR's turned in by the customers would be 
inducted into the repair phase of the repairables pipeline. 

In reality both situations contain flaws. Carcass 
returns are not independent of recurring demancs but 
actually a result of demands as detailed in the section on 
the repairable pipeline. Therefore, the logical approach 
is to try to tie the two forecasts together. This requires 
that the differences in the two forecasts be reconciled. 
This can be done via the WR and the RSR. The RDF includes 
movice code SA requisitions (which at SPCC accounts for 
8 percent of total recurring demands) which represents DLR's 
that are not turned in by customers and therefore should not 
be reflected in the CRF. By including 5A advice code 
requisitions as a reduction to the WR, this problem is 
solved. The other key problem is that not all DLR's turned 
in hy customers are inducted into the repair phase before 
they are surveyed. This results in the RSR being artifically 
high. By including surveys at the stock points and collection 


points in both the numerator and denominator of the RSR 
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algorithm, the RSR calculation 1s more in keeping with its 
definition. These two adjustments to RSR and WR in theory 
provide for 100 percent accountability of DLR's and reconciles 
—Ene RDF to the CRF. 

The SPCC-proposed models, as modified by discussion 


with NAVSUP recorded in [Ref. 25], are 


fe 
(DOPS. + CPS.) 
it 5 : 
E i 
aoe £-1 
(IND. +2.CPS.. ) 
. a. 1 
1=1 
eels 
). (DOPS. + CPS, + 5A.) 
Aon a 1 al 
ue = i=l , 
ie er 
dy ARD, 
1=1 
1 - WR, 
a RSR 
e 
CRE = RDF. x CRR, ' 
where: CRF = Carcass return forecast for period t, 
RDF, = recurring demand forecast for period ¢t, 
CRR, =Wearecass retusm rate for period t, 
WR, = wearout rate for period ¢, 
RSR, = PeCatn SUrVIVval Gace fOr period €, 
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DOPS . = designated overhaul surveys in period i, 


CPS. = collection point surveys in period i, 
SA, = actual advice code 5A demands in period i, 
ARD ; = actual total recurring demands in period 
1, and 
IND, = carcasses inducted into repair phase in 
period 1. 


SPCC recommends that the RSR and WR be kept as cumula- 
tive running sums from a predesignated starting point or 
period, vice exponential smoothed averages. Then, as time 
goes by, the actual RSR and WR would tend to approach steady 
state positions. This assumption is good if there is in fact 
mOtm percent accountability of DLR's. If, for instance, 
carcasses are lost in transit or the carcass tracking program 
changes the status of a due-in carcass to a 5A advice code 
demand, the WR and RSR calculations would have to be adjusted 
accordingly. Otherwise the two calculations might “lose 


eeack" over time. 


C. SUMMARY 

The models presented above represent a variety of fore- 
casting schemes from both forecasting theory and practice. 
This thesis will examine how these models perform with 
actual U.S. Navy supply system data. The data itself will 


pewcdetemlea in the next section. 
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In order to properly evaluate the forecasting models it 
was necessary to obtain a realistic data set. Since the 
model is to be used to forecast carcass returns for active 
SPCC repairables, the data were gathered based upon criteria 
built around the real-world system parameters. The following 
discussion will develop those criteria, detail the col- 
lection procedures and sources, and identify some of the 
problems associated with data collection, transfer and 


interpretation. 


A. DATA SELECTION 

The following criteria were used to identify National 
Item Identification Numbers (NIIN'‘'s) to be used in testing 
the forecasting models: 
1. Active items only (i.e. items that have had one or 
more demands per quarter). The current SPCC model only 
forecasts recurring demands for active items. Inactive 
items are not included in the recurring demand budget 
BPEevject@oms associated with UICP Stratification program 
(STRA®) . 
2. Only items with material cognizant (COG's) symbols 7G 
and 7H. COG's 7G and 7H are defined in [Ref. 26] as non- 


aviation depot level repairables, both managed by SPCcc. 


ge 





SPCC also breaks the COG's into four digit categories to 
further stratify demand patterns. The COG's selected were 
7Gxy and 7Hxy where X = Q, F or W and y = l, 2 or 3. 

3. Non-family items. A family is defined in [Ref. 27]: 
..-aS a collection of two or more items under the 
cognizance of an ICP that may have a common relationship 
to each other due to the existence of common applications 
in higher assemblies, end items, or weapon systems. The 
relationships between items in a family may vary widely; 
some items may be completely interchangeable while some 
items may have to be reworked before they can be 
substituted for another family member. 

The criterion for belonging to a family is basically 

interchangeability. Because of this the UICP programs 

assign the sum of these common applications to the item 
designated "head of the family" or the most common or 
preferred family member. The levels and forecasting 
schemes then make their projections based only on these 
family heads. In the selection of data for the purpose 

of testing the effectiveness of the various forecasting 

schemes all family items were deleted from consideration 

to eliminate potential problems. 

4. Item service entry date greater than or equal to 4 years. 

This is to allow the establishment of a normal pattern of 

failure and usage data (i.e. minimizing the “bathtub” 

celtability effect) . 

5. Only items managed by SPCC Stock Control Division (Code 

340). These items represent the mainstream items managed 


by SPCC that do not require extraordinary management 


attention such as controlled nuclear related parts. 


Wee 





It was decided not to distinguish between items that 
were repairable at TIR reporting activities and those 
repaired at non-TIR reporting activities. As discussed in 
the section on the TIR system, the UICP information on DLR's 
repaired at TIR reporting activity is more timely than from 
a non-TIR activity. Thus time frames are more representa- 
tive of actual carcass activity and movement. However, the 
current UICP programs do not distinguish between reporting 
and non-reporting TIR activities when making forecasts and 


other inventory calculations. 


Eee DATA COLLECTION 

The above criteria were imposed upon the MDF through a 
series of utility programs. This resulted in 4292 NIIN's 
being identified as candidates for testing the forecasting 
models. This list of NIIN's was then used with other 
Mmetlity programs to extract the desired data from both the 
IHF and THF. The following table lists the data extracted 
for each selected NIIN and the source (see Appendix B for 


eemene aGetailed listing of the data collection parameters): 


DATA CATEGORY SOURCE DESIGNATION 
List Cf all NIIN's MDF MDF 
Actual carcass returns ee ACR 
Recurring demands IHF RD 
Designated overhaul point surveys THE DOPS 
Collection point surveys THE CPS 





Inductions into repair phase THF IND 

Assets returned to "A" condition THF ACON 

Recurring demands by advice code THF 5A, 5G, 5S, 5X 
"A" condition is the condition code for a serviceable item 
within the supply system. Prior to "A" condition, the item 
is considered to be in "M" condition meaning it is being 
repaired. 

The data were collected during the period December 1981 - 
April 1982 and covered only the previous eight quarters. 
The data were limited to eight quarters because of data 
breakdown available in the IHF and THF files. The periods 


covered were: 


QUARTER PEREOD 
1 DiC a oe 3h Ebaoo 
2 MAR 80 - MAY 80 
3 JUN 80 - AUG 80 
a sae SOs NOV 30 
2 DEG 30 - ES si 
6 MRO lee ie eG 1 
a, JUN Si — AUG gi 
8 Siar Ge Oven o- 


The data were collected on tape files with one tape per 
transaction type. Each tape then listed all 4292 NIIN's 
with the accompanying eight observations representing the 
Summation of all the transactions occurring within each 


period. 
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=. DATA MANIPULATIONS 

The IHF data tapes supplied by SPCC provided eight 
Baabters Of data for each of the 4292 NIIN's. The THF data 
tapes contained only NIIN's where there was activity in at 
least one quarter, and contained only the quarters where 
there were observation totals greater than zero. 

The procedure was to standardize the data files so that 
all 4292 NIIN's were listed in the sequence of oldest 
quarter first and most recent quarter last so that the 
Fortran programs written to run and test the data could 
accomodate any of the files. To accomplish this, the 
following steps were taken using a series of utility 
programs to manipulate the data files: 


1. reorder the quarters of the IHF generated tapes 
by a program designated SORT Fortran, 


2. create a file of all 4292 NIIN‘'s from the MDF 
tape using program NIIN Fortran, 


3. expand the THF generated files to include all 
eight quarters per existing NIIN by placing 
zeros in the misSing quarters and then reorder 
the quarters as in step 1) through FORMAT 
Portran, 


4. process the revised THF generated files against 
the file of all 4292 NIIN's using program AUG- 
MENT Fortran resulting in a complete 4292 x 8 
file, and 


5. erase the original files in mass storage and 


Blace tEme revised, ready tO use IHF and THF 
generated files into mass storage. 
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bee DATA ADJUSTMENTS 

A Fortran program (SUMCOLS Fortran) was written to sum 
the total demands or carcass returns for each individual 
quarter and then print the results for a quarter-by-quarter 
comparison of the totals. This was done to highlight for 
each item any quarter that was grossly out of line with 
other quarters for either demands or carcass returns. The 


check revealed the following four situations: 





NIIN a 4 5 6 7 8 FILE 
00-938-3665 2 4 60,010 3 5 a 4 Z ACR 
00-937-8496 Ze ES 44,448 0 3 A 3 RD 


00-979-4575 34 40 oul. 6,496 138 763-123) 457 RD 
00-186-8289 17 OWeTC, OS LO eles ob 8 RD 
The four large data points (all from the IHF file) were 
checked by SPCC analysts and all were determined to be bad 
data. Four new data points were artificially inserted into 
the data files, with each replacement value selected within 


the range of existing numbers for the respective NIIN's. 


EB. “Daa CAVEAT 

The data used in this study covers the period December 
79 - November 81. On 1 April 1981, the funding of DLR's 
was changed from APA funding to NSF funding as discussed 
previously. This means that before 1 April 1981, the 
repairable was basically “free" to customers. After that 


time the customer was charged for the repairable an amount 
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based upon whether he had a carcass to turn in or not. This 
funding change was designed to encourage customers to return 
repairable items into the repairables pipeline by penalizing 
them for not returning a failed unit. The exact effect this 
change had on either demand or carcass return data is not 
explicitly addressed by this thesis, but, in fact, may have 


exerted a significant impact on the results. 
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Vee  OCUTDTER ANALYSIS 


Outlier analysis is critical to any research that uses 
real data. Dixon and Massey [Ref. 28] state that there are 
two types of “bad" data points that we want to either 
eliminate or be aware of - outliers and incorrect data 
points. Outliers generally are extreme observations, 
either very large or very small and can have a substantial 
effect on any standard regression analysis or standard 
Statistics used to judge the effectiveness of a forecasting 
method. Outliers and incorrect data points can result from 
such sources as: 

a) human error (1.e. a mistake either in taking the 
observation or in coding during the man-machine 


interface phase), 


6b) data point(s) may be from a population other than the 
one under consideration, and 


c) the population does harbor some abnormally large or 
small values that have surfaced and are legitimate 
(i.e. the proposed model of the underlying distribution 
may not be correct). 

Equally important is the possiblity that individual 
observations of any of the above situations may be present 
Within the range of the bulk of the data and not be recog- 
nized by the statistical techniques employed as being "“bad". 


As discussed in the previous chapter the Fortran program, 


SUMCOLS, was used to identify gross data elements in the 
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data set. The procedure identified the four erroneous NIIN 
values discussed in detail in that section. SPCC personnel 
confirmed that those numbers were indeed wrong and that the 
possible cause of their existence might have been keypunch 

or data entry error. With these four numbers corrected the 
model building and data analysis phase of the thesis began. 
It was soon apparent that there was a tremendous amount of 

"noise" in the data. 

A Fortran program named CHECK was written to provide a 
Side-by-side listing that matched recurring demands to the 
actual carcass returns for a particular NIIN over the eight 
Guarters of data. This procedure revealed many NIIN's with 
data that appeared out of line (i.e. where either the 
carcass returns were an order of magnitude different, either 


nigh or low, from the corresponding demands). 


Two examples are listed below: 
Centrifugal Pump 00-368-3186 


omR i 2 3 4 #3 8 


I~ 
Kee) 


ACR 0 0 0 0 0 0 0 Z 


RD 65 Spe 2 wee OZ ee) 1 IE eS oe 


Chamber Assembly 00-678-2686 


oR 1 2 3 4 58 6 


|— 
| co 


ACR 5 Bae) | 22 JG. 355-7 S66 S10 


RD 5 5 6 6 Ba u i Ms 


no 





SPCC explained that the pump was converted from 1H COG to 
7H in April 1981. Before that time the pump was not 
designated as a repairable and, therefore, not returned to 
the system for repair. SPCC also explained the anomalous 
behavior in the chamber assembly data by indicating that 
the part was being phased out of the system with no sub- 
stitute or replacement NIIN listed. 

Based upon discussions with SPCC personnel the following 
reasons (not an exhaustive list) were put forward as being 
possible causes of incompatible data in the ACR and RD 
Eres" 

1) Upon implementation of the DLR-NSF test on 1 April 1981, 
there was a moratorium on overdue or extra carcasses. 
The user could turn in any carcass(es) without reference 
to a specific demand or requisition number and receive 
credit for the carcass (this could lead to a cleaning 
out of workbenches). 

2) Possible incorrect coding of requisitions or turn-in 
documents so that a carcass receipt is not posted 
against the correct requisition and/or NIIN. 

3) Carcass turn in made by a ship going into an ROH where 
the equipment is deleted from the COSAL with the 
accompanying spares being returned without corresponding 
demands. 

4) Incorrect coding of a requisition as a non-recurring 
demand (when it should be recurring). When the carcass 
is subsequently returned it would be identified 
correctly as a carcass return, but there would be no 
corresponding recurring demand. 

These types of situations tend to result in imbalances 
in the ACR and RDtotals illustrated by the above two 


examples. In these situations neither autoregressive nor 


causal models would be effective in forecasting carcass 
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Zeturns. in addition, causal models built from noisy data 
could also prove to be a problem. Therefore, it was decided 
to apply a filtering procedure against the ACR and RD 
figures for each NIIN and to find a subset of NIIN's whose 
carcass return and recurring demand patterns and totals were 
related realistically. In developing the filter, it was 
assumed that carcass returns and recurring demands are 
positively related in some manner, and that there are many 
forces and actions within the supply system that cause 
outliers or erroneous data points to enter the data files 
that are not indicative of the underlying relationship of 
carcass returns to recurring demands. 

The purpose of the filter is to eliminate the data 
points extraneous to the model building process. All the 
models will then be synthesized using both the filtered 
and unfiltered data. 

The Fortran program OUTLIER was written to implement 
the criteria outlined in Table 2. The criteria are based 
Saeewo sums for each individual NIIN: the sum of actual 
carcass returns and the sum of recurring demands both taken 
over the eight quarters. The third figure computed is 2, 
#he ratio of total carcass returns to total recurring 
femaneases sin cheory, the ratio of carcass returns to 
recurring demands over the life of a particular item (1l.e. 
the steady state rate) should be approximately 1.0. In 


reality many carcasses never make it back to the repair 
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@ycle (i.e. 5A advice code requisitions and collection point 
Surveys) and in any short-run period carcass returns can lag 
behind their corresponding demands. These factors would 
make the ratio R somewhat less than 1.0. The lower bound 
for R was arbitrarily set at 0.5. The upper bound of R was 
set at 1.5 for total recurring demands less than or equal 

to 50. This is to allow for carcasses returning for demands 
recorded in a period prior to the eight quarters used in the 
project. For total demands of greater than 50, R was set at 
1.25. The cut-off point of 50 was also arbitrary, but 
selected to allow for two ranges for R since the quotient 

of a division operation will vary greater with a change in 
the numerator when the denominator is small. 

The program OUTLIER identified 2974 NIIN's as acceptable; 
that is, within the bounds as established by Table 2. This 
represents 69 percent of the original 4292 NIIN's and points 
out that a significant portion of the data may cause real 
problems in the implementation of any forecasting model. It 
also points out that some type of screening or filtering 
technique should be used to screen the data as is the case 
with the currently implemented UICP exponential smoothing 
model. 

Greomtanatiecaveet to filtering data 1s provided by 
Maicraidakis and Wheelwright [Ref. 29]. They state that 


judgment must be used as to when adjustments to data really 





will improve the accuracy of the forecast and when they will 
not. The key problem is that filtering also tends to 
eliminate some of the valid information contained in the 
data. While adjusting a data set facilitates the use of 
standard forecasting schemes, the results may not be as 


reliable with the loss of the outlying but relevant data. 
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VI. MODEL BUILDING 


This chapter deals with the formulation of regression 
models only. The first section discusses carcass returns 
regressed on total recurring demands and the second section 
details regression models with carcass returns as a function 
of recurring demands by advice codes. All regressions were 
linear and conducted on the Statistical Analysis System 
hoAS). 

In both cases the procedure was to obtain the parameters 
for the linear equation by running the regression on as much 
data as possible. This included data for all eight quarters. 
Therefore, the parameters were partially obtained by using 
data that was subsequently used to test those parameters 
against the MOE's. This overlap only involved the data for 
the last four quarters. As a result, this procedure will 
bias the MOE statistics. No attempt was made to identify 
Or measure the bias. It was felt that obtaining regression 
models using only data from the first four quarters (i.e. 
eliminating half of an already time constrained data set) 
would have caused more serious problems than the bias intro- 
Buced ante Ene MOE'sS by including all the data. 

As discussed in the section on regression models, the 


model used for regressions was: 
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Y= XK 6 +u ’ 


where: Y dependent variable, 


X = independent variable, 
8 = parameters to be determined, and 
u = error term. 


The following example will illustrate the procedure used 
to build the input matrix for SAS for all the regression 


models. Consider the model: 


ees, ARD. 


ie _ 35 ARD . _ 


it 2° 

Here the carcass return forecast (or average) is a function 
of the two previous guarters actual recurring demands (ARD) 
with no intercept term. Since there are eight quarters of 
available data, the third quarter carcass return forecast 
would be a function of actual demands in quarters one and 
two, the fourth quarter forecast would be a function of 


demands in quarters two and three and so on. This would 


correspond to a SAS input matrix configuration as follows: 


ACR ARD, ARD 


3 2 
ACR, ARD 5 ARD . 7} 
— a 
85 ’ 
L J 
ACR, | ARD ¢ ARD - 
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where: ACR, eeecetal. Carcass returns in period i, and 


ARD. 
1 


actual recurring demands in period i. 


In this case Y, the dependent variable, would be a (6 x 1) 
matrix and X, the independent variable, would be a (6 x 2) 
matrix. Since the regression is to be run on all 4292 NIIN's, 
Pepeecomes a ((4292 x 6) x 1) or (25,752 x 1) matrix and X 
mecomes a ((4292 x 6) x 2) or (25,752 x 2) matrix. When the 
regressions for this particular model are run for the 2974 
filtered NIIN's, the Y and X matrices would be (17,844 x 1) 
and (17,844 x 2) respectively. If the CRF is to be a function 
of the three previous quarters then the dimensions of the 
individual NIIN's Y and X matrices are reduced by one obser- 
vation each to become (5 x 1) and (5 x 3) respectively. The 
full X and Y matrices for both 4292 and 2974 items are 


correspondingly smaller. 


A. RECURRING DEMAND REGRESSIONS 

Table III lists the regressions run on recurring demands 
uSing all 4292 NIIN's. Table IV presents the regression 
results using the filtered NIIN‘'s only. Each model is 
individually identified by an alphabetic character (the 
ordering of the models does not have any Significance). A 
Single character designation (e.g. A) means that the model 
was a result of a regression on all 4292 items. A double 


character designation (e.g. AA) indicates that the model was 
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the result of a regression based upon the 2974 filtered 
items. The cumulative total column is the algebraic summa- 
tion of the parameters for each model. This total shows 

the percentage of recurring demands that are represented 

by carcass returns for each model. For example, Model A 
suggests that 65 percent of all recurring demands result in 
Meeadrease bLeturn. The column "intercept" is the Bo or inter- 
cept term in the regression line, "RD" means recurring demands 
in the current quarter, "RDM1" literally translates to recur- 
ring demands minus one (or a lag of one quarter). RDM2 means 
a lag of two quarters and so on. A blank entry in the column 
of any one model means that the coefficient of the respective 
column heading is zero. While all the standard regression 
statistics were calculated by SAS, only the individual model 
parameters, the R? Statistic and standard deviation of each 
model are displayed. In all cases the F statistic was 
Significant and the Durbin-Watson statistic showed no 
autocorrelation. 

All models were run with and without intercepts. In 
theory the intercept should be an adjustment factor to the 
explanatory variables not present in the model. In all cases 
the intercept term made a relatively insignificant contribu- 
tion to the forecast. 

Table V is a display of the models chosen for synthesis 
using the SPCC data. Models B and BB were selected because 


the CRF in period t is represented as a direct function of 
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the recurring demands also in period t. In practice the 
recurring demands for the current period are not available 
until the end of the period, so the CRF becomes a function 
of the recurring demand forecast as discussed previously. 
Models F and FF test the hypothesis that the CRF is simply 

a function of the actual recurring demands in the previous 
period. This model predicts the carcass returns on the most 
current, actual observation vice a forecast as in B and BB. 
This model is similar to the naive forecasting model, but it 
uses a coefficient other than one. Models D and DD combine 
the above models to make the CRF a function of both the 
current quarter's recurring demand forecast and the previous 
quarter's actual observations. Models L and HH were selected 
for testing because they have the highest R? statistics with- 
in their respective data groups. Similarily, models K and GG 
were selected for the lowest standard deviation calculations. 
It should be noted that models MM and NN both had more favor- 
able statistics than models GG and HH, but MM and NN were 
disregarded because in both cases the coefficient of the 
current quarter's recurring demand was a negative number. 
Intuitively, the recurring demands in a quarter could not 
serve to reduce the carcass returns expected to arrive in 
that period. Models N and PP were selected because of their 
intuitive appeal. It is realistic to expect that carcasses 
arriving in period t were generated by demands in period t-l 


and t-2. It also is a model that is predicated upon past 
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actual data and does not use any forecasted values. The t 
statistics of the parameters for all the models listed in 
Table V were all greater than |2|, thus significant at 
Significance levels of .05 and greater. 

It is interesting to note that the regression statistics 
in Tables III and IV are more a function of the data used to 
construct the model than the model itself. There was some 
variance among the statistics within each data set category, 
but not as Significant as between the data sets themselves. 
When all the data were used the me or coefficient of deter- 
mination tended to be approximately .5. This indicates 
that a significant portion of the total variance is not 
explained by the regression (i.e. the carriers selected). 
Thus the model does not fit the available data very well. 
This could cause the forecasts resulting from one of these 
models in any particular period to vary considerably as 
seems to be indicated by the large standard deviation 
Statistics. The statistics on the filtered data, as would 
be expected, show significant improvement. The standard 
deviation, however, is still relatively high. This could 
indicate that there are problems with the model or that 
carcass returns vary widely and are inherently difficult to 


ie ch aGite., 


93 





cree APvyECE CODE REGRESSIONS 

Due to the large number of possible carriers with respect 
to the advice codes and the SAS data capacity limitations, a 
subset of the 4292 item data set was used in the regression 
phase of the advice code model building. A ten percent 
random sample of the 4292 NIIN's was determined by a program 
RANDOM Fortran which called upon a computer library sub- 
routine that contained a pseudo random number generator. 
This procedure is detailed in Appendix C. 

Table VI contains the results of the regressions of 
carcass returns on advice codes. Table VI is constructed 
in a Similar fashion to Tables III and IV with the three 
categories of advice codes across the top of the display. 
The star behind a particular number indicates that that 
coefficient failed the t test (i.e. the t Statistic was less 
than |2|). The cumulative distribution column has been 
deleted. In the case of the regression uSing recurring 
demands only, the cumulative total effect could be employed 
because there was only one general category of explanatory 
variables. In the advice code model there are three distinct 
categories. 

Regression 9 was used to represent the advice code 
regression model even though models 1, 2 and 4 had slightly 
better overall statistics and more significant parameter 
values as determined by the t statistics. Model 9 was 


selected over those three because all of them required a 
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prediction of advice code demands in the period to be 
forecast. While there is a recurring demand forecasting 
procedure, there 1S no provision in the UICP system for 
forecasting the number of recurring demands for a period by 
advice code category. The model selected requires only 
advice code information that is available from the previous 


quarters. 
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VII. EVALUATION CRITERIA 


There are a number of measures of effectiveness (MOE's) 
or evaluation criteria to test any forecasting scheme. Each 
MOE iS unigue and will generally identify a specific fore- 
casting technique as superior to the others. However, this 
does not assure that all MOE's will identify the same method 
as being optimal. Therefore, five popular MOE's have been 
selected to test the various carcass return forecasting 
methods examined in this thesis. The evaluation and comment 
sections will discuss the merits of each forecasting method 


with respect to each of the MOE's listed below. 


A. MEAN ABSOLUTE ERROR (MAE) 


its 


( INCI. > (Eis) 4 | 


2 3) 
n 
where: ACR, = actual carcass returns for item i, 
GRE. = Garcass return forecast for item i, and 
n = total number of items being evaluated. 


The range of MAE is zero to plus infinity. 


B. MEAN ERROR (ME) 

The mean error criterion is divided into two ranges — 
positive errors and negative errors. This measure shows the 
bias Of a particular method towards either high (positive) 


or low (negative) forecasts and the magnitude of the biases. 
97 





1. Mean Positive Error (MPE) 


Np 
(ACR, = CRE. ) 


Np 


for all ACR, > CRF. , 


where: np = total number of observations where 
ACR; 2 CRF, . 


2. Mean Negative Error (MNE) 


Baal)! ACR. < CRFE., 
i- it 


where: nn = total number of observations where 


The range of both MPE and MNE is positive and each will be 


shown separately. 


S-) MEAN FORECAST ERROR (MFE) 


(CRF, = ACR; ) 


ths 


MFE = : 
n 


This MOE differs from mean absolute error in that all fore- 
casting errors are simply summed with their appropriate signs 


vice uSing the absolute values. This results in averaging 
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the positive and negative errors. Thus the range of this 
fem 1S from minus infinity to plus infinity. The optimal 
Forecasting method would presumably be the method with MFE 
closest to zero. The bias of the method is indicated by the 
Sign of MFE. If MFE is positive, the forecasting method 
tends to overestimate carcass returns and, conversely, if 


the MFE is negative it underestimates carcass returns. 


D. ROOT MEAN SQUARE FORECAST ERROR (RMSFE) 


where: MSE = mean squared error. 


MSE is discussed in detail by Makridakis and Wheelwright 

(Ref. 30]. MSE and RMSFE are often used because of their 
Similarity to the familiar variance and standard deviation 
calculations. They differ only in that variance is calculated 


uSing the mean of the observations vice the forecasted value 


(CRF.). 
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E. MEAN ABSOLUTE PERCENTAGE ERROR (MAPE) 


rn 
eee | 
ea 
MAPE = = 
ACR, - CRF, 
5, S| ACR, | x 100 ; 


where: PE. = percentage error for item i. 


This MOE is also detailed in [Ref. 30]. The range of the 
MAPE is zero to plus infinity. The same weighting is applied 


to both high and low estimates by a forecasting method. 
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VIII. MODEL ANALYSIS 


The results of the forecasting models synthesized with 
the SPCC data will be displayed and analyzed in this 
section. As a result of the outlier screening procedure, 
the models were run a) with all the SPCC data (identified 
as "raw" data) and b) only with the data that survived the 
filtering process (identified as "filtered" data). The 
results for each forecasting method are listed by MOE and 
quarter for the period December 1980 - November 1981 in 
Appendix D. The quarters correspond to the following 


pericds: 


QTR PERIOD 
5 DEC 80 - FEB 81 
6 MAR 81 - MAY 81 
7 JUN 81 - AUG 81 
8 SEP 81 - NOV 81 


The MOE is listed at the top of the page. The model and the 
data used to test the model are listed on the left-hand side 
of the page. The MOE's correspond to those described in the 
evaluation criteria chapter. The right most column is the 
average of the MOE's across the row. 

The MOE averages are carried forward for evaluation 


purposes and are displayed in Tables 7 - 1l in this chapter. 


HORE 





For each table the MOE is listed across the top margin with 
the model designation along the left-hand margin. As in the 
appendices, the models are separated by the data type, 
either raw or filtered. The number in each cell represents 
the average value for the designated model for that MOE over 
the four quarters measured in Appendix D. The asterisk 
indicates the best value in each column for a particular 


MOE. The MOE's are: 


MAE - mean absolute error 

MFE - mean forecast error 

RMSFE - root mean square forecast error 
MAPE - mean absolute percentage error 
MPE - mean positive error 


MNE - mean negative error 


"No." Indicates the number of observations that made up 


either MPE or MNE, whichever it follows. 


A. REGRESSION MODELS (REG) 
Table 7 summarizes the results for the regression models. 

The letter designated a particular regression model is 

keyed to the model as defined in the model building chapter. 
For the models run against all the data, Model B was 

Superior to all the others except in the category MPE where 

model FF was better. Models B and FF are Similar in that 


the CRF is simply the function of one explanatory variable 
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in each case. For model B, the forecast is a function of 
gust the recurring demand forecast which is exponentially 
determined. Model B, therefore, is the model that best fits 
using all the data. 

When the regression models were run with the filtered 
data there was no clear cut "best" model. Model BB did, 
however, show well in the two categories of MAE and MFE. 
Model BB also had a RMSFE that was close to the lowest 
values obtained. Model BB appears to provide the best fit 
when only filtered data are used. 

The results are interesting in that model B was obtained 
through regressions on raw data and then tested the best 
uSing the MOE's. Model BB is the same model as B, except 
that it was obtained through regressions on filtered data on 
which it subsequently tested as the best model. Both models 
identified carcass return forecasts as a function of the 
recurring demand forecasts. Model BB (determined by the 
filtered data) did a relatively good job of forecasting 
when all the data was tested, but conversely model B did not 
show particularly well against the filtered data except with 
respect to the MAPE measure. It is important to note that 
Eee medels did significantly better jobs of forecasting when 
the data was first filtered before being applied to the 


models. 
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B. EXPONENTIAL SMOOTHING (ES) 

The results of the pure exponential smoothing model are 
displayed in Tables 8 and 9 for raw and filtered data 
respectively. Unlike the UICP exponential smoothing model, 
these models did not have a filtering or screening system. 

For the models synthesized with all the SPCC data, Table 
Beconows that, except for MFE, [.35, .50] is the optimal 
range for a. This is greater weight than those used by the 
merPemodels (0.1, 0.3]. Again, it is important to note that 
no filtering is used in this model as in the actual UICP 
models. The MFE calculation is highest at a = .05 and is 
monotonically decreasing to its low value at the boundary 
value of a = 1.0 (or the naive forecasting model). The 
model that will be compared with other models will be 
a0 = .4 because it is in the above optimal range. 

Table 9 displays the results when the exponential 
smoothing models are applied to data that has already been 
filtered. Here, the model with a = .2 appears to be the 
best, even though there is little difference between it and 
the model with a = .25. Of interest is that MFE is not 
monotonically increasing as with the raw data, but the RMSFE 
ZS. 

For the exponential smoothing models there is a differ- 
ence between the MOE's as a result of using different 


input data, but not as significant as with the reqression 
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medels. This probably results from the exponential 
smoothing models being more "flexible" or robust with respect 
to data with large variances as compared to the fixed 
parameter regression models. The model with «a = 1.0 which 
predicts carcass returns as merely what they actually were 
Bamene last period did a better forecasting job than the 
respective regression models F and FF where carcass returns 
were a fixed percentage of recurring demands from the 


previous quarter. 


C. MOVING LEAST SQUARES (MLS) 

The moving least squares model results are listed in 
Maple 10. The left-hand column indicates "MLS" for moving 
least squares and the number of quarters used in each model 
for determining the forecast. In the case of both input 
data, the model predicated on the previous four quarters 
did the best. As explained previously, the model was 
limited to reaching back four quarters to obtain a base for 
making the forecast, and therefore, it cannot be determined 
if five or more quarters would have made better mcedels. The 
four quarter model does tend to smooth out outliers more 
than the two quarters models. While the models using fil- 
tered data did show slightly improved MOE statistics, the 
MAPE for both data sets was virtually identical indicating 
that the model is very robust and equally good (or bad) 


with raw cr filtered data. 
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D. MOVING AVERAGE (MA) 

The moving average model results are also listed in Table 
10 just below the moving least square results and identified 
as "MA" models. While the two quarter mcdels showed some 
promise, the four quarter models again were overall better. 
The four quarter models tend to smooth outliers into the 
forecast more effectively than shorter quarter input models. 
Again, aS in the MLS model, the results did not vary 
drastically for the raw and filtered data indicating that 


the moving average model is also fairly robust. 


E. ALL MODELS 

Table 11 lists all the models developed and discussed 
in the models section. It only includes one candidate 
variation of each of the models discussed previously in 


this chapter. The models are: 


SPCC - UICP exponential smoothing model in use at SPCC, 
ARR - adaptive response rate model, 

DEMAND - SPCC proposed demand/return model, 

LAG - time-lag carcass return model, 

REG-ADV - advice code regression model, 

REG-B - recurring demand regression model B, 

REG-BB - recurring demand regression model BB, 


MLS-4 OTR - moving least square 4 quarter model, 
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MA-4 QTR - moving average four quarter model, 
ES-a=.4 - exponential smoothing model with a = .4, and 


ES-a=.2 - exponential smoothing model with «a 


II 
N 


Using both types of data, the DEMAND model had the worst showing 
overall. Measured against the raw data, three techniques 
were approximately equal in their demonstrated forecasting 
abilities - the SPCC model, ARR and ES-a=.4. The SPCC 
model was the only one of the three to employ a filter. 

The three models are similar in that they all basically 
employ the exponential smoothing technique to produce the 
Forecast. The moving average and the moving least squares 
models were next in forecasting abilities, with the moving 
average model clearly superior to the moving least squares 
model. This could be explained by the fact that the MA 
model is simply the average of the previous four observa- 
tions, thus smoothing out extraneous data points while the 
MLS is a projection of a “best fit" line through the data 
points. The implication is that the carcass returns follow 
an average value pattern more than a demonstrated trend. 
The remaining models are all causal or regression type 
schemes with fixed parameters. As a group, they did not 
forecast with the same accuracy as the other models. The 
advice code regression model displayed the most potential 


as an estimator of carcass returns. 
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The current SPCC forecasting model makes the overall 
best forecasts when synthesized with the filtered data. 
Even though the RMSFE for the MA-4 QTR model is lower, 
the SPCC model does almost as well. The ARR model did as 
well as with the raw data, but the exponential smoothing 
model ES-a=.2 (no filters in the model as in the SPCC model) 
did almost as well or better than the SPCC model for all 
MOE categories. This is probably explained by the fact that 
the SPCC model &% value, which is either .1 or .3 depending 
on the trending present, brackets the ES model with a=.2. 
The high filter in the SPCC model is probably not necessary 
because of the filtering previously performed on the data. 
This would bring almost all of the observations to within 
Six Standard deviations of the average carcass return rate, 
thus virtually eliminating the high filter gross adjustments. 
Again the moving average model shows better MOE performance 
than the moving least squares model. The filtered causal 
models all show significant improvement in their forecasting 
abilities over their unfiltered counterparts except for the 
SPCC proposed DEMAND model which shows only slight improve- 
ment despite the filtering process. The model REG-BB which 
was determined through regressions on the filtered data does 
the best of the causal models. However, as discussed earlier 
there is probably some bias involved in using the same set 


of data to both derive the model and then test it. The 
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Significance of the regression model is that it may help to 
identify the carcass return pattern of a "normal" recurring 
demand situation. This results from eliminating the 
outliers before modeling. 

The models as a whole were able to forecast significantly 
better as measured by the MOE's when a filtering process was 


applied to the data before synthesizing with the models. 
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IX. CONCLUSION 


The following discussion will contain qualifications to 


the study, conclusions of the study and areas for further 


consideration. 


A. 


QUALIFICATIONS 


There are several qualifications to this forecasting 


SEUGy . 


18) 


2) 


5) 


4) 


The data used to build the forecasting models and to 
test the models was not a random sampling from all SPCC 
managed repairable items. The data selection process 
was constructed with the intent of identifying items 
that had an established observable pattern of recurring 
demand. Also the data were restricted to those 
recurring demands and carcass returns specifically 
identified to a particular item (e.g. no family items). 


The short time frame for which data were available by 
quarters from the IHF precluded the use of may time- 
series dependent models. This situation may also have 
contributed to the poor performance of the SPCC 
proposed DEMAND model because there may not have been 
a long enough start up or baseline period to establish 
long term (or steady state) repair survival rates and 
wearout rates. 


The lack of cumulative data totals and forecasts for 
all data items at the beginning of the study required 
that half of the data available for each item be used 
to either build the model to be tested or used as start 
up data for the forecasting techniques to be employed 
over the final four quarters actual data. The start 
up period necessarily limited the scope of the param- 
eters of some of the forecasting models - specifically 
moving average and moving least squares. 


The timing of the forecasting study may have been bad 


because of the initiation of the Navy Stock Fund - 
Depot Level Repairables Test funding change that 


1 7Al0, 








5) 


i. 


@eemereq i Aprit 1981. Thus five quarters of the data 
used in the study was pre-NSF funding of repairables 
and the other three quarters data was generated under 
stock funding. The purpose of the funding change was 
to alter the pattern of repairable demands and carcass 
Yretuans. 


There was no attempt to address the qualities of the 
UICP recurring demand forecasting scheme. 


CONCLUSIONS 


From the study, the following general conclusions can 


be rendered. 


a) 


2) 


5) 


4) 


Filtering the data prior to applying any forecasting 
technigue is critical. This point was illustrated for 
all the forecasting models when a gross filter was 
applied across the board against all data. The current 
UICP model which SPCC uses already employs a filter 
which was apparent in the results. 


The autoregressive models were superior to the causal 
models. Despite the cause and effect relationship of 
recurring demands to carcass returns, the methods that 
attempted to model this relationship did not forecast 
carcass returns as well as the models predicated upon 
previous carcass return patterns. This may tend to 
indicate that the two events follow separate under- 
lying distribution patterns. 


The exponential smoothing models were the best of the 
autoregressive models. The SPCC model, the adaptive 
response rate model and the pure exponential smoothing 
models all work on the same baSic principle. For use 
with raw data, the straight exponential smoothing model 
with a = .4 (no filtering) does as well or better a 

job of forecasting as does the current UICP model. 


The carcass return - recurring demand relationship 
could not be definitely established through regression 
analysis. Without filtering, all the models demon- 
Mieeated R< Statistics of approximately .5 with stan- 
dard Geviations of approximately 20. The regression 
models determined from the filtered data showed 
significant improvement in both statistics, but still 
exhibited large standard deviations of around 10. 
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5) The best forecasts made by the models were not very 


good from a relative standpoint. The best mean 
absolute percentace error was 64 percent. This 
results in a very wide confidence band around an 
estimate and does not eliminate the uncertainty 
surrounding the long procurement lead times that the 
forecasting models are used for. This is a result 
of one or both of the following: 


a) Ehe true underlying distribution of carcass returns 
is still not properly identified, or 


b) there are other factors causing wide data 
Pivetuations. 


These factors could include policies, funding, reporting 
procedures and/or handling procedures. These factors 
Obviously affect the recurring demand and carcass return 
patterns. 


‘Ge 


AREAS FOR FURTHER STUDY 


The following areas should be considered for further 


study: 


WW), 


2) 


Sy) 


4) 


=) 


outlier analysis techniques - how to properly identify 
and screen outliers from the data base, 


time-series analysis of carcass return forecasting - 
this will require an accumulation of quarterly data 
over a longer time period, 


forecast carcass returns as a function of fleet item 
population - this method would utilize the Weapons 
System Files at SPCC as the basis for forecasting, 


regressions based upon four digit ICP COG designations, 
and 


the effects of the NSF-DLR test on carcass return 
rates - regressions on data to determine before and 
after carcass return rates as functions of recurring 
demand. 


The material in this thesis could serve as a baseline 


for developing the above topic areas. 
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APPENDIX A 


MOVING LEAST SQUARES EXAMPLE 


QUARTER if 2 5 4 5 6 v7 
ACTUAL CARCASS 5 6 2 4 J 8 8 
RETURNS 

n= 4 


t=enr+tl=4+t1e2= 5 
First Input Qtrs 1-4 


perc@orainares 1-4, Y = 5, 6, 2, 4 


Regression Line £(X) = -.7X + 6 
X = 5 
Benpecast for Otr 5 = £(5) = -.7(5) + 6 = 2.5 Retual. 7 


Second Input Qtrs 2-5 


focoonteinates 1-4, Y = 6, 2, 4, 7 


Regression Line £(X) = .5X + 3.5 
X = 5 
memecast for Otr 6 = £(5) = .5(5) + 3.5 = 6 Actual 8 


Pieeaetnput Otrs 3-6 


X coordinates 1-4, Y = 2, 4, 7, 8 


Regression Line £(X) = 2.1X + 0 
X = 5 
Meipeesarecor Otr 7 = £(5) = 2.1(5) = 10.5 Actual 8 


P22 





Helstm Input Otrs 4-7 

X coordinates 1-4, Y = 4, 7, 8, 8 
Regression Line £f£(X) = 1.3X + 3.5 
X = 5 


Mermecast for Otr § = £(5) = 1.3(5) +3.5 = 10 Actual 9 
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APEENDIX B 


THE DATA COLLECTION PARAMETERS 


The following breakdown is the coding that was used to 


collect data from the SPCC THF file for each listed data 


Seacegory: 
DATA CATEGORY Data Cele —Ccez le NOrE 
PMeuectlons into repair DAC ~ M 
D8C = M 
Collection Point Surveys DAC F H 
Dae F H a 
DOP surveys DAC M H 
D8C = H 
Assets to "A" condition DAC M A 
D8C a A 
Demands by advice codes A0- - - 
A4- ~ - 
D7- - - 
NOTES: 
Peeonyeuntc& Leaentification code as part of the requisition 


number but NO0104 (indicating SPCC directed survey) 

2. the three document identifiers all represent recurring 
demand requisitions which were further broken down into 
recurring demands per quarter by specific advice codes 

- any condition code 


D.I. document identifier, see [Ref. 3] 


Cc- conditions code, see [{Ref. 3] 
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APPEND se 


RANDOM SAMPLING PLAN 


The following random sampling scheme was suggested by 
Dr. P. A. W. Lewis, Professor of Operations Research and 
Statistics, Naval Postgraduate School, Monterey, Ca. 

The objective is to obtain a 10 percent sample (or 430 
items) out of a population of 4292 NIIN's without repeating 
any items. The methodology was to establish a vector, call 
it L(I), with 4292 cells and an index register where 
ie—mlc,.--,4292. Initialize the value in each cell to 
correspond to the cell or index number (i.e. cell 1 or L(l1) 
contains 1, L(2) contains 2, etc.). Next draw a pseudo 
random number (call it R(1)) from the uniform [0,1] distri- 
bution using the IBM IMSL library program GGUBS. Multiplv 
R(1) by Imax (the maximum value in the index register - 4292 
at this point) and integerize to obtain a cell number (call 
Geamtijeesrom 1 to 4292. Then go to vector location L(N) and 
the number in the cell is the first number for the sample. 
Replace the number in location L(N) by the number in L(Imax) 
(which is still 4292 in this case) and decrement the location 
index I by one (now I = 1,2,...,4291). Repeat the operaticn 
430 times. The result is a vector of 430 non-duplicate 


numbers ranging from 1 to 4292. 
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The master NIIN file is a listing of all 4292 NIIN's in 
numerically ascending order. The vector represents the 
relative position of the NIIN's within the master list (i.e. 
number 2 in the vector corresponds to the second NIIN in the 
master NIIN list). Then using a locally generated utility 
program, this vector is applied to the master NIIN file and 
the 430 appropriate NIIN's are extracted. The 430 NIIN's 


represent the random sample. 
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APPENDIX E 


ACRONYM LISTING 


actual carcass return 

advice code 

Appropriations Procurement Account 
actual recurring demand 
adaptive response rate 

cognizant symbol 

collection point surveys 

carcass return forecast 
Due-in/Due-out File 
demand/return model 

data element number 

cepot level repairable 
designated overhaul point 
designated overhaul point survey 
economic order quantity 

economic repair quantity 
exponential smoothing 

Navy Fleet Material Support Office 
meno control point 
Inventory History File 
inductions into the repair phase 


moving average model 


LS 





MAPE 


MAPE 


MLS 


MNE 


MOE 


MPD 


MPE 


NAVAIR 


NAVELEX 


NAVSEA 


NAVSUP 


NIIN 


NPS 


NRE I 


NSF 


NSN 


EER 


mean absolute deviation 

mean absolute error 

mean absolute forecast error 
mean absolute percentage error 
Master Data File 

mean forecast error 

moving least squares model 

mean negative error 

measures of effectiveness 
movement priority designation 
mean positive error 

Naval Air Systems Command 

Naval Electronics Systems Command 
Naval Sea Systems Command 

Naval Supply Systems Command 
national item identification number 
Naval Postgraduate School 

not ready for issue 

Navy Stock Fund 

national stock number 

Planned Program Requirements File 
SUdrhcer 

recurring demand 

Ee-culrsing demand forecast 
regression model 


ready for issue 
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RMSFE 


ROH 


RSR 


SAS 


SDR 


SMA 


SECC 


STRAT 


re 


BoE R 


wa CP 


WR 


root mean square forecast error 
regular overhaul 

reorder point 

repair survival rate 
Statistical Analysis System 
Supply Demand Review 

supply material availability 
Navy Ships Parts Control Center 
S@raeetCation 

Transaction History File 
transaction item reporting 


Uniform Automated Data Processing System - Inventory 
Contcral Point 


wearout rate 
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